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STUDENT ACTIVITIES—AN INTEGRAL PART OF 
STUDENT PERSONNEL WORK 


E. G. WILLIAMSON 
University of Minnesota 

NuMEROUS writers on student personnel work have pointed 
out the rich opportunities for social adjustment, personality 
development, and citizenship training available via programs 
of student activities and organizations.‘ Proponents of pro- 
gressive education and teachers of social studies in elementary 
and high schools have developed practices geared to the objec- 
tive of deriving certain skills, attitudes, and information from 
learning by doing in the classroom, the school, and the com- 
munity. Testimony based upon observations by teachers and 
reports by students and alumni attest to the desirable outcome 
of such participation. Studies of the persistence of activity 
participation of high-school student leaders in both college and 
the adult community indicate that social skills and participa- 
tion habits, once firmly established, tend to continue as a per- 
manent effect of training.” It is recognized, however, that 
more evaluation studies of an experimental type are needed to 
supplement the few now available. 

With the desirability of learning social (not merely recrea- 
tional) adjustment through activity participation thus indi- 
cated, it is of importance to review the methods used to enlist 

1 Hand, Harold C., Editor. Campus Activities. New York: McGraw-Hill, 1938. 

Lloyd-Jones, Esther McD. and Margaret Ruth Smith. A Student Personnel 
Program for Higher Education. New York: McGraw-Hill, 1938, Chaps. VI and XI. 

Russell, John Dale, Editor. Student Personnel Services in Colleges and Uni- 
versities. Vol. XII. Proceedings of the Institute for Administrative Officers of 
Higher Institutions, Chicago: University of Chicago Press, 1940. See Chap. XVII 
by William E. Scott. ; 

Strang, Ruth. Group Activities in College and Secondary School. New York: 
Harper, 1941. 

2 Chapin, F. Stuart. Extra-Curricular Activities at the University of Minnesota. 
Minneapolis: University of Minnesota Press, 1929 


Courtenay, Mary Ethel. “The Persistence of Leadership.” School Review, 
XLVI (1938), 97-107. 
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students in such worth-while experiences. Restricting our dis- 
cussion to those student activities and organizations of a non- 
instructional nature, we observe on most campuses marked 
dependence upon mass advertising appeals through word of 
mouth, printed bulletins, posters, and student newspapers. 
Notable exceptions are observed in such institutions as Antioch 
College, Stephens College, and George Williams College. 
Rather does the writer refer especially to universities in which, 
to a large extent, those who transfer from high school with 
outstanding records of leadership tend to gravitate to new 
opportunities while other students, inactive in high school and 
who need new experiences, frequently gravitate to the side 
lines. Exceptions to this generalization are found on every 
campus, but the few surveys*® made of participation in activities 
indicate that approximately one-third, varying-in-terms of sex, 
class, and college within the-University,-of the students-seem 
to participate in campus affairs only by. attending~classes. 
These observations are in line with the extensive surveys of 
interests and activities made by Lehman and Witty, which 
indicate that the narrowest range of interests is found at age 
twenty-two years. Perhaps non-participation is related basi- 
cally to some psychological factors of adolescent development 
which are as yet not clearly identified and understood.* 

To these social bench warmers, publicity about opportuni- 
ties for leadership, or even followership, in activities brings but 
little response for a number of possible reasons. A certain 
number prefer to maintain their home community ties; others 
must devote every available hour to self-help employment. 
Some prefer to restrict participation to attendance at dances 
and to cheering the football team. But anyone who counsels 
college students knows of the many students who fail to develop 
those subtle skills, relationships, and “connections” which serve 
as entree to leadership and participation opportunities. Some-: 


3 Angell, R.C. A Study in Undergraduate Adjustment. Chicago: University 
of Chicago Press, 1930. 

Chapin, F. Stuart, op. cit. 

Brown, Clara M. “A Social-Activities Survey.” Journal of Higher Education, 
VIII (1937), 260. 

4 Lehman, H. C. and P. A. Witty. “The Psychology of Play Activities.” New 
York: A. S. Barnes, 1927. 242 pp. 
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times the cause appears to be bizarre dress or low or high inten- ~- 


sity of speech, and sometimes extensive shyness which may stem 
from myriad causes. Yet many successful participants and 


even leaders may exhibit these same characteristics. What- 


ever the inhibitors of desired participation, the prevalence of 
non-participation indicates a serious problem for many~stu- 
dents, not only from the standpoint of mental hygiene but 
equally | so from the point of the university’s responsibility for 
training youth in community and citizenship responsibilities 
and even in the everyday living and working with others with- 





out friction. If publicity alone does not produce participation \ 
of those who desire and need such experiences, then what can 


be done to guide students with respect to this phase of personal 


development? Parenthetically, it is no small task to identify } 


by name and person those who do not participate. Since they 
are not physically present at student events and affairs, special 
means must be employed to personalize-and individualize work 
with them. 

Numerous attempts have been_made-in the University of 
Minnesota to evolve a program which would facilitate the in- 
duction of students into activities_of interest-to—them. In 


these attempts there was no thought of high-pressuring all stu- | 


dents without regard to personal preferences of some for nor- 
mally restricted participation. Rather it was thought that 
publicity regarding the wide range of available opportunities 
and the increasing of this range would ipso facto attract all 
students who desired to participate. Our experience did not 


completely verify such an assumption. Even the development 


of a comprehensive and low-cost program of recreation in the 
new Coffman Memorial Student Union, while unusually suc- 
cessful in increasing participation in recreational affairs, has 
not solved the problems of an appreciable number of students 
who express a desire to join organizations but who do not 
respond to mass invitations of the publicity type. 

A brief review of other program developments in this Uni- 
versity will serve as background for the most recent innovation. 
In 1930 student leaders petitioned the late President Coffman 
to appoint a committee, with the writer as chairman, to study 





. 
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in a comprehensive way the social adjustment problems of 
students. Prior to this time an informal group of students and 
staff members had constituted itself a committee to coordinate 
the many duplicating and competing social programs, chiefly 
those of a dance nature. Under the leadership of the Univer- 
sity YMCA and YWCA a special “Fortnightly” program was 
developed, designed to induct the socially timid and awkward 
into college recreational programs. A balanced program of 
non-dancing games and beginner’s lessons proved to be very 
effective until its popularity attracted those who were already 
well versed in social savoir faire, thus crowding out those less 
adept. Interesting variety in the standardized pattern of 
couple-dancing was introduced by the department of physical 
education by means of square dances, outing activities, and 
intra-mural sports. 

The committee’s survey stimulated an expansion of the 
social-recreational program of the Student Union and led to 
the appointment of a Social Coordinating Committee which 
continues its attempts to plan a community program for the 
University as a whole. This committee, working with the 
Calendar Committee of the All-University Student Council, 
has achieved some success with respect to the problem of con- 
flicts in functions, programs and schedules of social activities. 

At President Coffman’s suggestion the Assistant Dean of 
Men developed a Leadership Course to coordinate and improve 
the efforts of student leaders in their conduct and leadership of 
organizational affairs. Little effect was noticeable with respect 
to increasing social participation but this group did achieve 
some success through its Social Etiquette or Skills Course. 

The YMCA and YWCA achieved notable success in the 
development _of small clubs. and—discussion_groups in which 
social adjustment was facilitated through intimacy of contacts 
and concentration of program events upon specific common 
interests. The YWCA groups are impermanent discussion 
groups while the YMCA groups are fraternal but non-Greek 
letter clubs of a continuing type. 

The above brief review indicates some of the expanded 
recreational facilities. Failure to participate was not caused 
by scarcity of opportunities. But recreation is only one of the 
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many types of social adjustment opportunities.’ In a normal 
peace-time year over three hundred student organizations spon- 
sor many_types of activities in_addition to_the recreational 
program conducted by each organization_ largely for its own 
members. These three hundred organizations cover the full 
range found on any campus, and provide rich opportunities for 
social adjustment, personal development and citizenship train- 
ing. The intensity of appeals issued by these organizations 
for student workers and participants and the relatively small 
attendance achieved at their affairs probably indicate both the 
ineffectiveness of the advertising methods used and the inertia 
or timidity of non-participating students. Each year during 
Freshman Week new students are harangued and cajoled with 
regard to “coming out” for activities “after getting your study 
habits developed.” 

Clearly students at Minnesota are presented with oppor- 
tunities and rather full information about them. Should one 
conclude that all those who desire to participate respond to 
these mass appeals and that those who remain away do so 
through desire or are satisfactorily adjusted in social relation- 
ships? The 1932 survey of participation (to have been re- 
peated in 1942) showed otherwise. Many non-participants 
reported lack of knowledge of how to begin or indicated hesi- 
tancy in making the first step—perhaps mass advertising meth- 
ods have_reached their maximum_usefulness and must be sup- 
plemented by other more individualized methods. Perhaps 
we need in college to heed the experience of group workers in 
community agencies with respect to the special need for per- 
sonalized and individualized induction of new members into 
adolescent group life.* Perhaps we in Minnesota will find that 
these problems have been solved elsewhere, but an extensive 
search of the literature and personal observations indicates 
otherwise.’ At any rate the following developments indicate 
our continued search for solutions appropriate to this campus. 


5A similar conclusion has been reached by leaders in the field of community 
group work. See Joshua Liebermann, “Group Work Aims and Progressive Educa- 
tion,” p. 83 in New Trends in Group Work. Ed. by Joshua Liebermann. New 
York: Association Press, 1938. 

6 Svendsen, Margaret. “Group Work as Individual Guidance,” p. 206 in Lieb- 
ermann, Joshua, o?. cit. 

7 As a result of a survey of extracurricular activities at nine midwestern univer- 


~~ 





~ 








8 EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


As of July 1, 1943, certain functions related to the super- 
vision of student organizations and activities were regrouped 
administratively in a new Student Activities Bureau within the 
Office of the Dean of Students. The following functions were 
assigned to the Bureau’s staff: 


1. Administration of policies and regulations established by the 
Senate and the President concerning such matters as scholastic 
eligibility to participate in activities, program, time and place 
of recreational parties and affairs, and the like. 

2. Advising with organizations regarding programs of all types, 
including organizations and programs designed to serve as 
“threshold schools” for new students and non-participating 
older students who need transition group experiences from 
high-school to college organizational participation. 

3. Cooperation with faculty advisers of student organizations; 
development in student organizational leaders of an under- 
standing of group and individual responsibilities for the welfare 
and interests of the many non-participating student followers. 

4. Financial supervision of financial affairs of organizations. 

5. Counseling individual students regarding the choice of and 
progress in extracurricular activities, organizations, and affairs. 


The Bureau’s staff is composed of both men and women and 
includes two graduate assistants. This staff will deal with the 
organizational and activity affairs of both men and women, 
thereby differing markedly from the situation on many cam- 
puses where separate offices often make for difficulties with 
respect to affairs organized for both men and women. In such 
a middle western state university as Minnesota, the number 
of joint activities has markedly increased in the past two 
decades. Separate student organizations for women will, how- 
ever, be continued and the special interests and problems of 
women will not be ignored. 

The first and fourth functions listed above need no descrip- 





sities, Marks concludes: “There is no university in this group which attempts to 
identify on a university-wide basis students who need attention with reference to 
their extracurricular programs” (p. 11). “In many cases it appeared that the stu- 
dent was not really being counseled, but was being given general advice, typically 
a suggestion to get into some activity group or possibly a referral to some activity 
director or leader. This is probably particularly true where student counselors were 

used who had been only superficially trained in this work. . Except in the case 
of freshman women and dormitory residents in some universities, the attempts to guide 
and direct students were for the most part limited to those students who sought out 
the help that was offered. There is reason to believe that many of the students who 
needed the counseling service most were not receiving it” (p. 12). See Abstract of 
Ph.D. Thesis on “The Personnel Point of View and the Administration of Extracur- 
ricular Activities in Nine Universities” by Arlyn Marks. Urbana, Illinois: University 
of Illinois, 1940. 
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tion in this paper. The second function constitutes the Uni- 
versity’s equivalent of community group work in a social 
agency. The staff members serve both as group-work super- 
visors and program advisers, and student leaders and faculty 
advisers serve as volunteer group leaders. The Bureau’s staff 
serves in advisory and supervisory capacities and not as admin- 
istrators except in those cases when an organization’s program 
is of such a nature as to jeopardize the University’s public 
telationships. Experience indicates clearly that such instances 
occur infrequently when the relationships between student 
leaders and staff members are characterized by the term ad- 
visory as opposed to administrative. The staff serves as a 
resource of suggestions regarding new programs and events 
when student leaders and faculty advisers seek assistance. 
Without such new ideas, organizational programs sometimes 
tend to become monotonously stereotyped and fail to attract 
student participants. A further phase of program advising 
involves the coordination and community-wide planning of the 
programs of the several hundred organizations in order to mini- 
mize the undesirable conflicts, program and personal, which 
often arise as a result of failure to clear information and sched- 
ules of events. 

The fifth function, personal counseling, calls forssome de- 
scription. As has been the case on most campuses, many at- 
tempts have been made at Minnesota to deal effectively with 
the need for assisting students to choose extra-curricular and 
recreational experiences in line with personal needs as outlined 
in preceding paragraphs. For the most part these attempts 
have taken the form of dispensing information about activity 
opportunities through the medium of bulletins, posters, “Ac- 
tivities Day” during Freshman Week, student counselors, and 
faculty counselors. Our experience has indicated that_this 
method of counseling through activity information is probably 
no more effective than is the corresponding method of dispens- 
ing occupational information in the field of vocational guidance. 
Some students need only information about opportunities in 
order to choose experiences which prove to be valuable and 
effective. But many other students need both information 
and personal counseling, Just as the past decade at Minnesota 
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has been devoted to the developing of both clinical and faculty 
counseling programs in the field of educational and vocational 
guidance, it is expected that the present decade will be devoted 
to the development of counseling programs in the areas of stu- 
dent finances, discipline, and social adjustment through par- 
ticipation in extra-curricular activities. Descriptions of the 
evolving programs concerned with financial and disciplinary 
counseling are in process of preparation. 

While the precise dimensions to be taken and the techniques 
and procedures to be used in the projected activity counseling 
are not now known, our experience to date indicates certain 
things it will not become. Although it must be closely coordi- 
nated with mental hygiene counseling provided by psychiatrists 
and psychologists and with clinical counseling regarding edu- 
cational and vocational problems, activity counseling will 
differ from these in that it will extend beyond group therapy 
for serious maladjustments and beyond the measurement of' 
aptitudes and interests. It will be as much concerned. with 
“normal” students as with those in serious emotional difficul- 
ties. As now projected, activity counseling will provide assis- 
tance to students in the transition from the simpler society of 
home communities and high schools to the more-complex 
society of adolescents which we call a university. In this sense 
zthe Activities Bureau will be an agency (but not the only one) 
for the induction of new members into the college society. For 
those students who are able to make their own induction transi- 
tion, it-will perhaps be unneeded. But for the large number 
_ of students who experience difficulties in taking this step, it 
~ will offer personalized services to supplement the mass methods 
‘used at present. Such a service may be unnecessary on many 
campuses but it appears to be needed in this particular type 
of university. It should be emphasized that this type of activ- 
ity counseling is supplementary to many other types of ser- 
vices, some of which are formally organized and others of which 
operate informally. It should also be emphasized that par- 
ticipation in activities is conceived as only one of several media 
for achieving that degree and type of social adjustment which a 
particular student may desire and need. There is no thought 
of standardizing either the means or the ends of personal devel- 
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opment in the area of social relationships, but rather a type of 
assistance which will aid the student in selecting appropriate 
means to achieve what he conceives to be desirable and satisfy- 
ing personal objectives. Other media for achieving social 
adjustment will be utilized, including both organized and 
unorganized recreation and personal contacts, attendance at 
as well as participation in planning and conducting activities, 
residential living experiences, home relationships, and class- 
room and personal contacts with students and teachers. 

While it may appear to the reader of descriptions about this 
and other phases of Minnesota’s personnel program that ours 
is a highly compartmentalized organization, such is not the 
case. In a large university, specialization in personnel func- 
tions is not only possible but it is also necessary from an admin- 
istrative point of view if the large number of students are to be 
served. While such specialization, with its attendant adminis- 
trative departmentalization, does introduce difficulties of ad- 
ministrative and program coordination, discussed elsewhere,* 
the resulting improvements in effectiveness of personnel, ser- 
vices is a worth-while gain. Incidentally, these specialists sup- 
plement but do not supplant faculty counselors, who serve 
effectively as “general practitioners” in counseling. 

The Activities Bureau, as is now true of other personnel 
departments, serves as a focal point of a personnel function 
but not as an exclusive monopolizer of a function. The Coun- 
seling Bureau has served as a pace setter for faculty. counselors, 
actually helping to increase faculty participation in counseling, 
which now takes place literally in every building on the.campus. 
In similar manner it is expected that the new Activities Bureau 
will provide leadership in enlisting the faculty counselors in the 
use of activities as one means to further personal development 
of students. It is hoped that through this program, students’ 
organizations and activities will be viewed by more teachers as 
having worth-while educational and professional values rather 
than merely a_ distracting effect upon students’ intellectual 
efforts. 


8 Williamson, E. G. “Minnesota’s Program for Coordination of Decentralized 
Student Personnel Services.” Report of the Sixteenth Annual Meeting of the Ameri- 
can College Personnel Association, 1939, pp. 101-116. 
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The beginning of a program of evaluation is being set up 
with the establishment of the Bureau. For the first year, in 
addition to those students who are referred or come voluntarily 
for counseling, a special group of several hundred students from 
the College of Education is being invited to use the Bureau’s 
facilities. This group was selected because of the special 
motivation to be derived from the fact that effective profes- 
sional adjustment of teachers is dependent to a large extent 
upon adequate social adjustment. Follow-up studies of these 
students will be made with respect to the detectable outcomes 
of participation. Comparisons will be made between this ex- 
perimental group and others composed of students who make 
adjustments unaided by counselors and those who fail to par- 
ticipate. An unusual method of identifying students who may 
need personalized and individualized counseling was developed 
as a phase of the required speech examination of all new stu- 
dents conducted by the Speech Clinic. The Clinic’s staff is 
alert to the possibilities in activities for personal adjustment 
and personality development. Such cases are referred to the 
Activities Bureau for personal counseling regarding group-life 
adjustments. It is expected that the first few years of experi- 
ence will be devoted largely to perfecting counseling proce- 
dures, delineating types of adjustment problems, and testing 
criteria of the outcomes of participation and non-participation. 
Among the criteria to be investigated are persistence of par- 
ticipation, degree and type of change from-high school to col- 
lege, subjective reports of satisfaction or dissatisfaction, allevia- 
tion_of associated adjustment problems, and other factors, in 
relation to leadership or followership and type of activity. 

With the establishment of the Bureau and the initiation of 
an evaluation program, it is expected that the student activity 
phase of the University’s student personnel program will gradu- 
ally yield experiences indicative of its true values. Not the 
least of these values may be the creation of awareness in coun- 
selors of the range of social adjustment problems of students 
and also an understanding of the therapeutic effectiveness of 
group adjustments as supplementary and coordinate with indi- 
vidualized counseling procedures and programs. , 











PREDICTION OF SCHOLASTIC SUCCESS IN COL- 
LEGES OF LAW: II. AN INVESTIGATION OF 
PRE-LAW GRADES AND OTHER INDICES 
OF LAW SCHOOL APTITUDE’ 


WILLIAM MICHAEL ADAMS 
University of Iowa 

Tuis study was undertaken with the objective of discover- 
ing additional indices of aptitude for successful law school 
achievement which might, in conjunction with the legal apti- 
tude test described in an earlier paper (1), provide a more 
adequate basis for advising students who contemplate entering 
the College of Law of the University of Iowa. Specifically, it 
was the purpose of this investigation to determine the relative 
validity of pre-law grade-point averages and scores on the Jowa 
Qualifying Examination as predictive indices of success in first- 
year law at the University of Iowa. 

Because of the variations in grading standards at different 
undergraduate colleges, only those students who had completed 
all their undergraduate work at the University of Iowa and 
who had complete records for one year of work in the College 
of Law were included in the major portion of this study. These 
students were selected from entering classes from the years 1936 
to 1939, inclusive. The number and percentages selected from 
each class are presented in Table 1. 

The predictive indices available for the group of 152 stu- 
dents selected included grade-point averages for pre-law work, 
and scores on the Jowa Qualifying Examination. The Iowa 
Qualifying Examination, which had been administered to all 
the members of this group as entering freshmen in the liberal 





1 Second of two parts of a condensation of a dissertation submitted in partial 
fulfillment of the requirements for the degree of Doctor of Philosophy in the Depart- 
ment of Psychology, in the Graduate College of the State University of Iowa, July, 
1942. 
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arts college, consisted of the Jowa High School Content Exami- 
nation, Iowa English Training Examination, Iowa Mathe- 
matics Aptitude Test, and the Jowa Silent Reading Test. A 
composite score, consisting of a weighted total of the raw scores 
on the four examinations, had been computed. The raw scores 
on the individual sub-tests of the battery and the composite 
score had been converted to percentiles and were available in 
this form. It was assumed that these percentiles were equiva- 
lent from year to year and, for purposes of computation, the 
percentiles were converted to linear scores by use of the modi- 
fication of Hull’s table prepared by Guilford (3). 


TABLE 1 


Number and Percentage of Students Selected from Various 
Freshman Classes in the College of Law 











Year Total enrolled* Total selected Percentage 
| aS eae 85 33 38.52 
Es ed be o's 96 38 39.58 
| See 99 39 39.39 
a 107 42 39.25 
NE so sa3 ss 387 152 39.28 





* The total number enrolled in each class included students who completed their 
pre-law work at other institutions in whole or in part, those who withdrew in the 
course of the year, and those registered as freshmen for more than one year. 

On the basis of findings of similar studies made in other 
schools of law by Crawford and Gorham (2), Husband (5), 
and Jacobs (6), it was decided that it might be profitable to 
make separate studies of the predictive value of the total pre- 
law grade-point averages, the junior year pre-law grade-point 
averages, the pre-law grade-point averages in social sciences, 
and the pre-law grade-point averages in physical sciences, as 
well as of the scores on the Jowa Qualifying Examination for 
this group. 

The available criterion of success in first-year law consisted 
of a weighted total of the numerical grades assigned in each law 
course completed by the student during his freshman year in 
the college of law. These weighted total grades were converted 
to ranks for each class, and the ranks were converted to linear 
scores by the method suggested by Hull (4). These linear 
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scores constituted the actual criterion measures utilized in the 
correlational analysis. 

The performance of the criterion group of 152 students in 
the aptitude tests and pre-law areas studied is summarized in 
Table 2. 

TABLE 2 


Student Performance in the Iowa Qualifying Examination and 
Pre-Law Work 











Predictive index N M S.D. Range 
Iowa Qualifying Examination: 
1. Composite score ....... 152 58.97 16.32 Linear score 18-93 
Percentile 5-99 
2. High School Content ... 152 59.98 16.79 Linear score 21-93 
Percentile 7-99 
3. Mathematics Aptitude .. 152 58.12 18.23 Linear score 7-93 
Percentile 1-99 
4. English Training ...... 152 53.52 16.09 Linear score 14-93 
Percentile 3-99 
5. Silent Reading ........ 152 57.02 16.30 Linear score 11-93 
Percentile 2-99 
Total pre-law G. P. A. ...... 152 2.58 501 1.55-3.94 
Jr. yr. pre-law G. P. A. ...... 152 2.67 553 1.47-4.00 
Soc. sci. pre-law G. P. A. ..... 152 2.65 490 1.73-3.95 
Phys. sci. pre-law G. P.A.... 152 2.47 647 1.17-4.00 
Total pre-law G. P. A. ...... 361* 2.58 A496 1.52-3.94 
ss yr. pre-law G. P.A....... 361* 2.63 538 1.47-4.00 
otal pre-law G. P. A. ...... 83+ 2.63 497 1.64-3.75 





* A supplementary study was made of 361 students. 

+ A second supplementary study was made of this group of 83 students. 

The mean linear scores of this group on the Jowa Qualifying 
Examination and its sub-tests were definitely superior to the 
scores of liberal arts freshmen as a whole, but the range was 
very wide, varying from scores corresponding to the fifth to the 
ninety-ninth percentile in the composite score. The mean total 
pre-law grade-point average’ of 2.58 for this group was also 
superior to the grade-point average of approximately 2.20 
achieved by students of the College of Liberal Arts as a whole, 
but probably not much superior to that of liberal arts seniors. 
Again the range is wide, extending from a grade-point average 
of 1.55 to one of 3.94. From these data it would appear that 
the typical University of Iowa student who enters the College 
of Law at Iowa is definitely superior, as a freshman, on the Jowa 


2 Grade-point averages are computed at the University of Iowa by considering 
A=4, B=3, C=2, D=1, Fd=0. 
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Qualifying Examination and maintains a somewhat better than 
average record in his liberal arts work. 

Inspection of Table 3 reveals that a moderate correlation of 
.47 was found between the composite scores of the Jowa Quali- 
fying Examination and the criterion of success in first-year law 
for the 152 students who had received all their pre-law training 
at the University of Iowa. A multiple correlation of only .50 
was obtained between the criterion and an optimum combina- 
tion of the scores on the four sub-tests of the Qualifying Exami- 
nation for this group. Of the indices studied for this criterion 


TABLE 3 


Correlation of the Predictive Indices with the Criterion 











Predictive index N r 

Iowa Qualifying Examination: 
IIE INE os cian le oc o%o'n'sj0: 0c in'a'o 152 A471 
2. High School Content Examination ...... 152 376 
3. Mathematics Aptitude Test ............ 152 338 
4. English Training Examination .......... 152 418 
5. Silent Reading Test .....ccccesecccsecs 152 425 

Pre-law grade-point averages: 
ORME MCA WER: onic ac csccuscccceveciees 152 668 
A ens or ere 152 615 
PND 62. Gnainls sas ac sivienc a ealeea'ee 152 642 
SIN EN os 5 bis a 'nicichs bie Kaveh. e'oissas 152 462 
eh ee ee rere 361* 579 
OIE eee oe va as waco oa oun 361* 554 
ROEM OTN MR 55 oo 5s oid dda s.ccce ke sees 83t 452 





* A supplementary study was made of these two indices for 361 students regard- 
less of the institution in which they had taken their pre-law work. 

+ A supplementary study was made of this index for 83 students who had taken 
all their pre-law work at institutions other than the University of Iowa. 
group, the total pre-law grade-point average appears to con- 
stitute the most valid single index of success in first-year law, 
correlating .67 with the criterion. A multiple correlation of 
only .68 was obtained between the criterion and an optimum 
combination of total pre-law grade-point averages and com- 
posite scores on the Qualifying Examination. Apparently ad- 
dition of this latter index adds little to the predictive value of 
total pre-law grades. 

Since it was found that, over the period of the study, stu- 
dents entering the University of Iowa College of Law had com- 
pleted all or part of their undergraduate training at 85 different 
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institutions, supplementary studies were made of available pre- 
dictive indices for two different groups. The first of these 
studies, based on the undergraduate transcripts of 361 students, 
regardless of the institution in which they had taken their pre- 
law work, yielded a correlation of .58 between the criterion of 
success in first-year law and total pre-law grade-point averages 
and a correlation of .55 between the same criterion and junior 
year pre-law grade-point averages. A second supplementary 
study, based on the undergraduate transcripts of 83 students 
who had completed all their pre-law work at institutions other 
than the University of Iowa, yielded a correlation of only .45 
between total pre-law grade-point averages and the criterion 
of first-year law school performance. It would appear, there- 
fore, that total undergraduate grade-point averages do not con- 
stitute a very effective index of scholastic success in law for 
students who enter the College of Law of the University of Iowa 
from other undergraduate institutions. 

In order to evaluate the possible efficacy of requiring a 
Bachelor’s degree as one of the criteria for admission to the 
College of Law of the University of Iowa, the first-year law 
grades of 212 students who had entered the law school prior 
to obtaining their Bachelor’s degrees were compared with the 
corresponding grades for 149 students who had received their 
degrees before entering the law school. A critical ratio of 2.13, 
significant at approximately the 2 per cent level of confidence, 
was found between the means of the linear criterion scores for 
the two groups, indicating that the former group was actually 
superior in first-year law school performance to the group who 
had received their Bachelor’s degrees before entering the law 
school. This finding is in agreement with the results of similar 
studies in several other law schools. A further study of these 
two groups revealed that the former group was slightly, al- 
though not significantly, superior to the latter group with re- 
spect to total pre-law grade-point averages. Apparently selec- 
tive non-intellective factors such as motivation, chronological 
age, and continuity of college attendance, as well as scholastic 
aptitude, must be invoked to account for the superiority of the 
students who entered law school after only three years of pre- 
law preparation. 
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Conclusions 


On the basis of the findings of the studies presented in this 
and a preceding article (1), the following conclusions seem 
justified: 

1. The experimental edition of the Jowa Legal Aptitude 
Test appears to show considerable promise as a predictive index 
of scholastic success in first-year law for populations similar to 
those included in this preliminary investigation, as evidenced 
by correlation coefficients of from .48 through .76 between total 
score and first-year law achievement in five colleges. Further 
experimentation with this test, involving larger criterion groups 
and utilizing more rigorous statistical techniques, should even- 
tually result in a much shorter and more valid final edition. 

2. Of the predictive indices, other than the legal aptitude 
test, studied in the present investigation, total pre-law grade- 
point averages appear to constitute the best single index of 
success in first-year law for students entering the College of 
Law of the University of Iowa from the undergraduate division 
of this institution. The validity of this index is considerably 
higher for students who have taken all their pre-law training 
at the University of Iowa than for students who have taken 
part of their undergraduate training elsewhere. For students 
who have taken all their pre-law work at other undergraduate 
institutions, the predictive value of pre-law grades alone is too 
low to be of much value for individual prediction. 

3. Composite and sub-test scores on the Jowa Qualifying 
Examination do not seem to be sufficiently valid indices of 
scholastic success in first-year law to be very useful for pur- 
poses of individual prediction at the University of lowa. Com- 
bination of these indices with total pre-law grade-point aver- 
ages by the method of multiple correlation does not materially 
increase the predictive efficiency of this latter index. 

4. In a comparative study of the relative scholastic success 
in law of students who entered the College of Law of the Uni- 
versity of Iowa after only three years of undergraduate prepa- 
ration and students who received their Bachelor’s degrees prior 
to entrance, no evidence was found to indicate the desirability 
of requiring college graduation as a prerequisite for admission 
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to the college of law insofar as scholastic achievement in first- 
year law was concerned. However, it should be remembered 
that the requirement of a college degree might be fully justified 
on other bases not investigated in this study. 

5. A properly weighted combination of scores on the Jowa 
Legal Aptitude Test and total pre-law grade-point averages 
appears to constitute the best quantitative index of success in 
first-year law at the University of Iowa available at present, 
as evidenced by a multiple correlation of .77. It is possible 
that the legal aptitude test scores alone will yield the best pre- 
diction for students who have taken most of all of their pre-law 
training at institutions other than the University of Iowa. 

6. Improvement of our ability to predict scholastic success 
in law will probably result from experimentation with optimal 
combinations of pre-law grade-point averages, scores on im- 
proved tests of legal aptitude and, possibly, comprehensive col- 
lege achievement examinations and objective measures of non- 
intellective characteristics as yet not adequately subjected to 
quantification. Of these latter, such factors as interests, per- 
sonality, perseverance, health, and personal history data in gen- 
eral are in need of further investigation. Further analysis of the 
intellectual functions required in legal studies and the develop- 
ment of more specific tests for their measurement are needed. 
Such studies will be facilitated by all improvements in the relia- 
bility of the criterion of success itself. 
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A TECHNIQUE FOR EVALUATING ASSEMBLED 
EVIDENCE OF POTENTIAL LEADER- 
SHIP ABILITY 


G. E. MANSON anp G. L. FREEMAN 
Northwestern University 

THE rapid expansion of our armed forces and the growth 
of new government agencies has created a shortage of men of 
proved executive talent. Consequently, the personnel expert 
is under considerable pressure to develop methods for selecting 
men of potential leadership ability. In this task, it is essential 
to pool such pertinent information as is available. The pres- 
ent report deals with methods used in selecting a group of 
young men with aptitudes for business leadership. It is 
offered as one approach to a difficult problem of personnel 
selection. 

A number of large companies with a policy of training col- 
lege graduates for executive positions have been faced with the 
problem of appropriate selection. Such companies rarely re- 
veal their selection techniques, and consequently there is little 
available information upon the subject. This was the situa- 
tion presented to Northwestern University’s Personnel De- 
partment fifteen years ago when it had to select from high- 
school seniors throughout the country, ten young men who 
would be subsidized in a special training course for “executive 
work in the field of business.” The group, known as The 
Austin Scholars, were to receive a stipend covering the expenses 
of four years of college plus a year’s travel abroad. As a result 
of this subsidy there was no dearth of applicants, and standard- 
ized procedures had to be instituted for their progressive elimi- 
nation. 

The method of selecting Austin Scholars evolved around 
four interlocking problems. These were (1) making a job 
21 
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analysis of the duties and qualities of business leaders, (2) 
securing a population sample likely to contain potential busi- 
ness executives and assembling information relevant to its lead- 
ership qualities, (3) judging upon the basis of assembled evi- 
dence the relative degree to which individuals possessed the 
desired qualities and (4) selection from the top ranks of rater 
judgment upon the basis of personal interview. Each of these 
problems will be discussed in turn. 


I. Job Analysis 


In order to make an intelligent selection of men to be 
trained for future executive positions, it was first necessary to 
ascertain the special qualities found in persons who were already 
successful on the job. Under the auspices of its director, Dr. 
D. T. Howard, the Personnel Department of Northwestern 
University prepared suggestions for a functional job analysis 
and submitted these to recognized business leaders for correc- 
tions and recommendations. The analysis which emerged 
paid attention both to the factors held in common by execu- 
tives and all men of talent and to the differentia of the job,— 
that is, the functions, methods, and abilities which distinguished 
it from other types of work. Among the factors common to all 
men of talent primary weight was given to intelligence. The 
differentiating features were less easily defined through study 
of the functions of the business executives. These were listed 
as follows: 


1. The executive must secure and evaluate information. 

2. He is required to be a planner and work-organizer. 

3. He must engage in conferences and communicate ideas 
effectively. 

4. He must assume responsibility, making decisions and 
standing by them. 

5. He must maintain effective interpersonal contacts and 
have a reputation for personal integrity with both his 
employees and associates. 


The personal qualities judged most appropriate to the suc- 
cessful execution of the above functions were divided into five 





a, 
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classes: (1) pfysical traits and endowments likely to favor 
effective communication of ideas, (2) mental abilities essential 
to the planning and organization of work, (3) social talents 
involved in the cooperative and directive phases of executive 
performance, (4) character traits contributing to confidence in 
one’s integrity, and (5) cultural accomplishments making for 
personal distinction, leadership, and prestige. 


II. Sampling Procedure 


With the foregoing analyses as a guide, the Personnel De- 
partment next proceeded to secure its sample of high-school 
seniors and to obtain information of likely value in estimating 
the leadership potential of the individuals under consideration. 
On the assumption that high-level intelligence is a necessary 
starting point for further screening, this was the first point of 
emphasis. Letters were sent to over a thousand high-school 
principals, asking them to post a circular describing the Austin 
Scholarship Program and to recommend their most promising 
students who met the following qualifications: 


Only those students will be considered who stand in the upper 
tenth of their graduating classes in scholastic achievement. Appli- 
cants must be of sound health, able to talk well and write well, must 
be leaders among their fellows, and must be respected in their com- 
munities for their moral and personal qualities. They must not have 
previously attended college elsewhere, and no person need apply un- 
less it is his intention to prepare himself for executive work in the 
field of business. 

In the year covered by this report 441 young men signified 
their interest by inquiring about their eligibility for Austin 
Scholarships. Of this number 109 did not follow their inquiries 
with formal application and an equal number were found in- 
eligible for reasons ranging from lateness of application to lim- 
ited scholastic requirements. This left 223 young men who 
satisfied all technical requirements. They came from 35 dif- 
ferent states and the District of Columbia. A folio compiled 
for each of these applicants carried the following information: 


Form A. Personal history, including photograph, place of 
residence, schools attended, interests and activi- 
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ties, outside employment, and future occupa- 
tional plans. 

Form B. Complete record of health from family physi- 
cian. 

Form C. Complete scholastic record from high-school 
principal. 

Form D. Ratings on five personality attributes (leader- 
ship, originality, popularity, speaking ability, 
and character) secured from three persons well 
acquainted with the applicant. The complete 
rating form, referred to as Form D, is given 
herein. 

Form E. Standardized intelligence test (Psychological 
Corporation, Test VI) given by high-school 
principal and returned to the Personnel Bureau 
for scoring. 

Form F. Standardized English placement test (Columbia 
Research Bureau English Test) given by high- 
school principal and returned to the Personnel 
Bureau for scoring. 

Form G. Correspondence and supplementary letters. 


III. Rating Assembled Evidence 


With 223 superior applicants technically eligible for the 10 
Austin Scholarships, some process of further screening had to 
be set up so that due consideration could be given each case in 
the assignment of relative rank. The technique finally devel- 
oped involved five steps: (1) breakdown of list of candidates 
into groups of thirty each, in order of completion of applica- 
tion; (2) further breakdown within each group of thirty, so 
that three raters independently ranked the leadership qualities 
of each candidate relative to a group of ten applicants; (3) 
rejection of two-thirds (approximately) of the total group, 
largely upon evidence from objective tests; (4) reranking of 
remaining candidates (in groups of ten) by three new raters; 
and (5) combining, for each candidate, the rankings received 
from the six raters and then selecting for further study by inter- 
view those candidates who composed approximately the upper 
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third of the composite “order of merit” list. This procedure 
of progressive elimination first reduced the list of 223 applicants 
to 80 applicants and finally to 25 applicants. It should also be 


FORM D 
Estimating Scale of Personal Characteristics* 


PICHBE TAREE Dei CUCUEEE OF EES 6 is 0: oo .n:a'c o's acckgsn c Hanke eb eiee sdine Sj eromlels elev ais s 
without consulting him and return this sheet to the Director of Personnel, North- 
western University, Evanston, Illinois. The man you are asked to estimate for us 
is an applicant for an F.C. Austin Scholarship. If you are his friend, as is likely to 
be the case, please remember that these scholarships are designed to prepare men for 








executive positions in business. Should the man we are considering pursue a business 


career? Is he really adapted to it? 


Give us your best judgment on his capacities. 


you to express your judgment in a form as concrete as possible. 


Might he not do better in some other vocation? 
The scale below is designed to enable 








1. Some men have distinct talents 
for leadership. They are looked up 
to by their fellows, are put in po- 
sitions of honor and are expected to 
take the lead in any enterprise that 
may be started. At the other ex- 
treme are persons who are content 
to be followers, and are never asked 
to head up any sort of enterprise. 
Inbetween lie persons of varying 
degrees of leadership ability. How 
would you estimate this individual 
in comparison with his fellows? 


(D Outstanding as a leader. 

CJ Is very often a leader. 

CI Average. 

(Is inclined to follow 
rather than to lead. 

CO Distinctly a follower. 


Please record 
here instances 
that support 
your estimate, 
and give rea- 
sons for your 
judgment. 





2. Some men are independent and 
creative in their thinking. They 
have “ideas of their own,” they 
analyze and interpret, invent, write, 
propose ways of doing things. Oth- 
ers are not original in this fashion, 
but seek to know how things are 
done by others before trying any- 
thing themselves. Your estimate 
of the individual should be based 
on what he does. 


(0 He is unusually original 
in his thinking. 

C Distinctly more creative 
than the average 
person. 

(CO He is as original as most 
people. 

C Inclines to depend on 
others for his ideas. 

(1 Shows no inclination to 
do original thinking. 





3. Some men are quite generally 
pleasing to their fellows. Others 
make an unfortunate impression on 
most people whom they meet. The 
distinctly agreeable personality is 
welcome in all circles, is invited out, 
and has a large number of acquain- 
tances. The unpopular personality 
is not sought after by others, and 
is frequently neglected if not posi- 
tively shunned. Consider the in- 
dividual you are estimating in terms 
of his popularity; in terms of the 
attitudes actually shown by others 
toward him. 





(J One of the best-liked men 
in his community. 

(1 Quite popular. 

( Average. Welcome, but 
not distinguished. 

(Not so fortunate as most 
people in social 
standing. 

(J Impresses most people 
unfavorably. 
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FORM D—(Continued) 
Estimating Scale of Personal Characteristics* 








4. Some men are able to speak in 
such a way as to hold the attention 
and communicate ideas clearly and 
readily. At the other extreme there 
are persons whose speech is slow, 
hesitating, and very ineffectual. In- 
between are varying degrees of 
speech ability. Consider the per- 
son you are estimating in compari- 
son with others. Do people under- 
stand him quickly and readily? Do 
people listen to him with ease and 
pleasure? Or is the opposite the 
case? 


(CO Outstanding as a speaker 

(] Above average in ability 
to convey ideas. 

() Does as well as most 
people. 

C Not a very good talker. 

( Distinctly inferior in his 
speech. 


Please record 
here instances 
that support 
your estimate, 
and give rea- 
sons for your 
judgment. 





5. Some people arouse the great- 
est confidence in others. They are 
regarded as trustworthy in any situ- 
ation, and people generally have the 
greatest respect for their integrity. 
The opposite extreme is the wholly 
untrustworthy person who is known 
not to be reliable, and is never de- 
pended on. Consider this man as 
you know him yourself and as he 


CIs most highly respected 
and trusted. 

(0 Has a good reputation 
for dependability. 

[Is as reliable as most 


people. 

(Is frequently found to be 
not dependable. 

(CO Reputation for reliability 
not good. 


is known by repute, and indicate 
where he stands, in the matter of 
reliability, in comparison with his 

fellows. | 











ce” ENCE LSS INT orn AA OG OR Eee TA 
* This form was prepared by Dr. D. T. Howard. 


noted that as a result of the methods used, each candidate in 
the first elimination series received a man-to-man comparison 
with three different groups of ten candidates each, and that 
those who survived to the second elimination series received 
similar man-to-man comparisons with three more groups of 
ten candidates each. A random sampling technique was used 
for placing a candidate in the ten-unit groups assigned to raters. 
While there was some duplication, the total constitution of 
each group was thus different for each rater. By this method 
each applicant was assured of a ranking by each of three raters 
(6 for those who survived first elimination) and was compared 
with a number of other candidates, but not in groups so large 
as to make relative ranking difficult or meaningless. The de- 


vice tended to prevent inequalities which might appear if the 
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different groups of ten each were, as groups, unequal in ability 
or achievement. It also made for efficient work-organization 
in the Personnel Department, since it enabled raters to start 
on the elimination problem before all applications were com- 
pleted and at times which fitted into their other work-sched- 
ules. That the rating method was fairly reliable is indicated 
by the following intercorrelations between raters. In the first 
ranking procedures, reliability coefficients between judges were 
as follows: 1 and 2, r=-+-.70; 1 and 3, r—=+ .69; 2 and 3, 
r==-+.73. In the second ranking procedure, reliability coefh- 
cients between judges were as follows: 4 and 5, r—=-+ .54; 4 
and 6, r=-+ .61; 5 and 6, r==+ .73. When rater evaluations 
given candidates who survived both competitions were com- 
pared, the following intercorrelations resulted: 


TABLE 1 


Agreement of 6 Judges in Total Rating of Applicants 
Who Survived First Elimination 











Rater No. 1 2 3 4 5 6 
PD ighasaeusaics 
Bras yet ached Zl 
D can cwecsnies 69 73 
See en wf, 58 64 
Wm cues iet 74 72 65 54 
Bo Bocca 74 64 61 61 73 





Agreement of average rating, group A judges (1, 2, 3) and group B judges (4, 
" OF liability of average rating of six judges (Spearman-Brown formula): r=.91. 

The size of the individual reliability coefficients indicates 
that there were relatively few wide variations in the rating of 
applicants. Examination of the table shows the usual ten- 
dency for reliability to increase as the final score becomes an 
average of a greater number of ratings. A reliability coefficient 
of .91 would indicate that the technique of rating is about as 
consistent as the usual objective examination. 

We shall next discuss the qualifications on which the candi- 
dates were compared in the above procedure. There were 14 
of these qualifications and these were considered one at a time. 
The procedure was to examine the assembled information con- 
tained in the folder of each of the ten members of a given 
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group with respect to the quality under consideration. The 
individual judged to have the most favorable manifestation of 
the quality was arbitrarily given the highest rank of 10, and 
the applicant with the least favorable manifestation a rank 
of 1. The final ranking was the summation of the individual’s 
positions on the 14 qualities listed below, after the leadership 
rank had been given a triple weighting and the character score 
a double weighting. 
GUIDE TO RATERS 


Consider the assembled evidence in each candidate’s folder with reference to each 
of the following qualities and assign him a relative rank (10 to 1) in each case. (Do 
not consult objective test scores.) 

1. Graduating Class Rank (Consult Form C) 

It is obvious that the high man in the graduating class of 20 has not reached 
his position with as much competition as has the high man in a graduating class of 
200. In order to take this factor into account transfer the high-school graduating 
class ranks into sigma positions, and rank these standard scores from 10 to 1. 

2. Course of Study (Form C) 

We know that modern high schools in large cities are apt to be better standard- 
ized than smaller schools in remote territory, and that some states have better school 
systems than others. We may at times have knowledge concerning the standards 
of specific private and public schools. Furthermore, within a given school there are 
“solid” and “soft” courses of study. The applicant whose high-school program was 
filled with “solids” is to be preferred to one who offers a minimum. The rating here 
should be made upon the basis of the quality of high school attended and the quality 
of the program pursued. 

3. Social Background (Forms D and G) 

While we do not care whether the applicant’s family is, or is not, socially and 
financially prominent in the community, we do ask that the applicant have had a 
stimulating home environment. Has he lived in an atmosphere in which ambition 
was aroused and intellectual interest encouraged? Has he been led to make social 
contacts of some range? Above all, have his family and friends shown an interest 
in his work and progress? 

4. Appearance (Forms D and G) 

Include in this judgment only external appearance, since physique is rated 
separately. Look at the applicant’s photograph and judge whether he has a strong 
face and masculine appearance. Avoid favoring the “pretty face,” and look for the 
face of a leader rather than of a matinee idol. Many items of information will be 
found in letters and form D ratings which concern the general impression which the 
applicant makes on people at first sight. 

5. Physique (Form B 

Is the applicant well-proportioned? Is his health good? Other things being 
equal, an applicant of good health and sturdy physique should be favored. 
6. Attitude toward Sports (Form A) 

Since we are looking for all-round men, the applicant’s attention to outdoor 
sports is of importance. We know that a healthy attitude toward sports is char- 
acteristic of manliness. Men who go in for individualized sports such as golf and 
swimming should be considered as well as those who make competitive school teams. 
7. Leadership (Forms A, D, and G) 

This item is given triple weight in our total estimate of the candidate, and so 
should be rated very carefully. Judge to what extent the applicant has been a 
leader rather than a follower. Special attention should be given to positions of 
leadership which the applicant secured through election or appointment by his 
fellow students. 

8. Initiative (Forms A, D) 

Does the applicant do only things he is told to do or does he start things on his 

own account? Is he enterprising? An organizer? Does he have hobbies that 
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show an investigative turn of mind? Has he shown initiative in his work, his 
activities, or his correspondence with us? Is he putting this application through 
on his own account or is somebody doing it for him? 

9. Participation (Forms A and G) 

Consider the variety and extent of the applicant’s extra-curricular activities. 
Avoid the introvert who lives a shut-in sedentary life and favor the man with an 
interest in the active affairs of his community. If the student has been compelled 
to work while in school, remember this may have interfered with extra-curricular 
activities. An applicant who has done considerable work should have this activity 
scored heavily in his favor. 

10. Oral Expression (Forms A, D, and G) 

That applicant should receive a high rating who has the ability to express his 
ideas effectively. Men who have been chosen to speak on various occasions should 
be favored. Pool all the information about the applicant’s ability to speak good 
English in estimating this quality. 

1l. Written Expression (Forms A, D, and G) 

Written expression is held so important that we give a special test to all appli- 
cants. The score made on that test is not considered here. Instead, base judgment 
on the composition exhibited in applicant’s correspondence with us, on his English 
record in high school, and what is said of his writing in letters. 

12. Populanty (Forms D and G) 

The applicant should be a person who is generally well liked and at the same 
time respected and looked up to as a leader. He should be liked by all groups of 
people with whom he has had contact and not just by students of his own age. We 
especially seek to avoid the person who is looked upon as odd or freakish by his com- 
panions. That student who wins the respect of all classes of people and exhibits 
ability to make goed contacts with all groups should be marked highest. 

13. Character (Forms D and G) 

Character is a broad word and includes morals, the observance of social con- 
ventions and personal integrity. We must also consider steadiness, reliability, de- 
pendability, and, above all, the applicant’s sense of social responsibility. This rating 
is emphasized in the final "judgments by multiplying the score made by 2 
14. Color (Forms D and G) 

This item takes into account the “individualizing” aspect of the applicant. Some 
men have a drab and commonplace personality; some are colorful and dynamic. Is 
the applicant a real individual, a vivid personality? This may frequently be judged 
partly upon the basis of the applicant’s correspondence with us and partly from 
statements made about him by his teachers and friends. Remember we are seeking 
individuality in applicants, but not to the extent of eccentricity. 


It will be recalled that two further items of information 
have not been used in the above evaluation of applicants. 
These are the scores on standardized tests of mental alertness 
(Form E) and English (Form F). Although our present 
approach would be to combine such objective test rankings 
with the total rating score, in 1932 the objective tests were 
used to eliminate two-thirds of the applicants who composed 
the original sample. That is, those applicants who failed to 
place within the fifth decile’ or better on both tests were ex- 
cluded from further consideration. Such a drastic procedure 
was dictated largely by a desire on the part of the University 


1 These were in terms of Austin Scholar norms, which were 117+ for test E and 
180+ for test F. Comparison with the norms originally established for both these 
tests showed that the decile rating for individual scores ran one to two deciles higher 
on the Austin norms. 
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that, above all, the men selected should excel in scholarship. 
We now question if such an overweighting of the intellectual 
factor was necessary in view of the high academic record of the 
applicants in high school. 

Reviewing the steps taken in selecting Austin Scholars, we 

have: 

(1) Rating all qualified applicants on fourteen qualities by 
three (Group A) raters. 

(2) Elimination of applicants who did not have a fifth 
decile or better standing on both the psychological and 
English examination. 

(3) Re-rating the 14 qualities of applicants who have met 
the standards (imposed in 2) by three new (Group B) 
raters. 

(4) Eliminating the lower two-thirds of applicants on the 
Group B ratings (imposed in 3), and calling the upper 
third (here 25 applicants) for personal interview. 


IV. The Personal Interview 


It may be recalled that up to this point, the Personnel De- 
partment had only indirect contact with applicants and had 
made its evaluations upon the basis of assembled evidence. It 
was deemed advisable, therefore, to base the final elimination 
upon a personal interview. These interviews were handled by 
the Director of the Personnel Department, with some assistance 
from business leaders in the case of certain candidates. The 
person conducting the interview did not know the previous 
rank order of the applicants referred to him. Consequently, 
he could obtain unbiased impressions. The thing most sought 
in the appraisal interview was evidence of mental agility, earn- 
estness of purpose and ability to handle oneself effectively in 
a difficult situation. The results of the interview were now 
evaluated against the evidence already assembled on the 25 
candidates, and the final selection of 10 was discussed in con- 
ferences between the Director of Personnel and the six raters 
who had participated in evaluating evidence. In terms of their 
relative ranking on assembled evidence (Part III), the ten 
selected stood Ist, 4th, 5th, 8th, 9th, 13th, 14th, 16th, 20th, and 
last in the group of twenty-five. 
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V. Evaluation of Method 


The personnel worker is naturally interested in the outcome 
of the men selected by our method. Unfortunately, it has not 
been found possible to complete fully the file of each Austin 
Scholar five years after graduation. But the fact that a num- 
ber of Austin “rejects” enrolled in Northwestern University of 
their own accord makes possible certain group comparisons 
between scholars and non-scholars. The grade-point averages 
for 10 Austin Scholars was 5.73 and for 20 non-scholars was 
4.90. This difference approaches significance (C.R. 2.1). 
Furthermore, a numerical check of campus activities during 
the four years of college gave the Austin group an average 
count of 12 and the non-Austin group an average count of 7 
activities. The difference is not statistically significant. 

Such evidence of leadership ability is difficult to evaluate 
and a better test is a comparison of the scholar and non-scholar 
groups in terms of achievement after graduation. We selected 
for this purpose ten men from both the scholar and the non- 
scholar groups whose post-school records were complete. In 
the non-scholar group we find, some time after graduation, a 
salesman for a meat-packing firm, a research associate for a 
peace organization, a minor civil service employee, an auto 
salesman working for his father, a salesman for a book concern, 
an accountant, a chemical engineer, a high-school teacher, an 
office assistant in a large grocery chain, and the assistant gen- 
eral manager of a national manufacturing organization. The 
scholar group contains, besides accountants for two large in- 
dustrial organizations, two specialists in industrial engineering, 
a high-school teacher and five men who have risen to mana- 
gerial authority in large corporations. Included in this most 
successful group of former Austin Scholars is the associate edi- 
tor of a national magazine, a purchasing agent, an executive 
assistant, a plant superintendent, and an assistant sales man- 
ager. While quantification of such evidence is difficult, it 
would appear that many Austin Scholars have done well in the 
business world even during an economically unsettled decade. 
The above evidence is influenced by the training given to 
Austin Scholars as well as by the selection method. 
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From a fifty per cent return of questionnaires sent to scholar 
and non-scholar groups five years after their graduation from 
the University, it appears that the five Austin Scholars who 
replied earn higher salaries, do more supervisory work and 
receive more promotions than do the five non-scholars who 
replied. Averages are given in Table 2, together with Fisher’s 
t tests of the significance of the differences found. 


TABLE 2 


Comparison of Average Salary, Number of Persons Supervised and Number of 
Promotions Received by Scholars and Non-Scholars 











Average Number Average 
yearly persons number 
salary supervised promotions 

ee Se ere 5,200 16.2 52 
Non-Scholars ...... 3,100 8.8 3.2 
Difference ......... 2,100 7.4 2.0 
PMID a 25 kas ox ne 6.5 10.3 3.5 
Significant at ...... 1% level 1% level 1% level 





All differences are significant at the 1% level. 
VI. Comment 


It is recognized that the proposed technique for selection 
of potential leaders has received no precise validation. Never- 
theless, its internal consistency might commend it to business 
organizations, military boards, and government agencies who 
have to select from a large number of applications for a given 
job. By using a rating form appropriate to the job, the sorting 
of application papers can proceed in an orderly fashion. The 
authors recommend especially that applications be assembled 
in groups of thirty as they are received and that this number be 
broken into three random groupings of 10 each, so that each 
application is evaluated by three different raters in reference to 
a somewhat different sampling. By considering only the top 
third rankings (average of three raters) from each group of 
thirty, a large number of applications can shortly be reduced 
to more workable proportions for a second comparison by a 
fresh group of equally competent raters. If necessary, the top 
third can again be skimmed from the second comparison and 
arranged for re-ranking a third time. By such a method, the 
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men finally chosen. will have been ranked by a number of raters 
relative to several groups of applicants and in reference to a 
fixed set of criteria. 

The authors hold no special claim for the specific criteria of 
leadership ability used in the present selection procedure. 
These are probably no better nor worse than the lists of quali- 
ties now in use elsewhere in the rating of leadership potential. 
It should be pointed out that before any such list of qualities 
can be used with precision, it will be necessary to determine the 
degree to which each item discriminates between leaders of 
demonstrated ability and non-leaders. Until then, the relative 
weighting of items on a leadership rating scale must rest largely 
upon the opinion of the examiner. The authors feel that ab- 
stract intelligence was overweighted in the selection of Austin 
Scholars. The fact that this type of overweighting is charac- 
teristic of most leadership selection procedures is no justifica- 
tion for its continuance. It seems that personnel workers 
might well give further study to an alternative proposition. 
This proposition is that since leadership is a social quality, it is 
better judged by evidence of effective social interaction than 
by non-social tests of individual ability. 





























JUDGMENTS IN COUNSELING’ 
RALPH F. BERDIE 


University of Minnesota 

VocaTIONAL counselors in student personnel programs at- 
tempt to assist students make judgments about their own 
Capacities, potentialities, and personalities. The counselor 
supplies the student with two things. Primarily, he gives the 
student information about himself and his relationship to his 
surroundings. The student is told how his various abilities 
and interests, as estimated by test scores and past achieve- 
ment, compare with the abilities and interests of people in dif- 
ferent jobs, schools, and curricula. The counselor then helps 
in the use of this information so that the student can make a 
sound judgment regarding plans for the future. 

Techniques for estimating abilities and interests have been 
discussed by many writers and summarized by others (1). 
Methods of assisting students in arriving at judgments have 
- been discussed by Williamson, Rogers, and others (4,2). Be- 
fore a student can understand his situation and plan for the 
future, he must make comparisons and discriminations. In- 
formation that has been analyzed and evaluated results in 
judgments, which in turn lead to decisions, which in their turn 
lead to action. 

An attempt to adopt methods of clinical psychology and 
psychiatry in vocational counseling has led to a difference of 
opinion regarding underlying philosophies and_ techniques. 
One group of workers emphasizes the judgments that the coun- 
selor must make. Another group expresses the opinion that 
it is not only unnecessary but also undesirable that the coun- 
selor make judgments. The counselor, according to the latter 

1 This article is adapted from Factors Associated With Vocational Interests, by 


Ralph F. Berdie, a Ph.D. thesis on file at the University of Minnesota Library. 
Professor D. G. Paterson was the author’s major advisor. 
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group, functions only to assist the student in arriving at judg- 
ments and does not provide judgments of his own whith the 
student can accept or reject. 

The view of the group deeming the counselor’s judgment 
essential is expressed by Williamson (4, page 118): 

It should be repeated that in vocational counseling the counselor 
collects data about the student’s potentialities and then proceeds to 
compare these data with the requirements of the student’s expressed 
occupational choice. In this way he arrives at a diagnosis of apti- 
tude and a judgment as to the wisdom of that choice. This com- 
parison of potentialities with preferences is the important step in 
diagnosis. Following this step comes the interpretation to the stu- 
dent of the counselor’s diagnosis and the cooperative planning of 
next steps. 

The judgments studied in this investigation were judgments 
made by counselors about students, and the results are there- 
fore most relevant for those counselors subscribing to the school 
represented by the quotation from Williamson. 

When a student seeks vocational counseling, he usually is 
considering one or more possible vocations and he is attempting 
to make a judgment regarding the relative appropriateness of 
the considered vocations before deciding to enter one. The 
large number of factors serving to attract a student to various 
vocations results in one vocation usually being more or less pre- 
ferred over others. Students seldom are considering two or 
more vocations all of which seem of exactly equal attractiveness. 
They have preferred vocations and they want to determine if 
they should enter those vocations. To assist in this determina- 
tion the counselor and the student organize information based 
upon school grades, aptitude and ability tests, achievement 
tests, interest tests, personality scales, hobbies, and work ex- 
perience. This organization usually results in both the coun- 
selor’s and the student’s making judgments about the appro- 
priateness of vocational choices. The counselor’s judgments 
may be the most effective force in molding the student’s 
judgments. 

This study sought to determine how consistent different 
counselors were in making judgments about vocational choices 


2 Italic is the original author’s. 
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and what factors were instrumental in their arriving at these 
judgments. The judgments were all based upon the same 
material, i.e., case folders, and the counselors all had gone 
through a series of training clinics that supposedly supplied 
them with a common knowledge of the relevancy of the tests 
used and the data collected. 


Methods 


Twenty case folders of pre-college men were selected from 
the files of the Testing Bureau of the University of Minnesota. 
The vocational choice of each of these students had been judged 
in the first counseling interview as either appropriate or inap- 
propriate by the counselor. The case notes were then reviewed 
by a case reader who verified the judgment of the original coun- 
selor. A duplicate folder was then prepared for each of the 
cases and all identifying data, such as name of student, name 
of father, etc., were removed. The following material was con- 
tained in the folder in this order: 


1. The preliminary interview report—containing the student’s 
stated problem, his high-school record, and observations made 
by the receptionist. 

2. The summary profile of test scores—containing the names of 
the tests, the raw scores, the percentile scores, and the norm 
groups. ‘Tests given at the Testing Bureau include tests of 
scholastic aptitude, scholastic achievement, special abilities, 
and personality. 

3. The Strong Vocational Interest Blank profile. Scores were 
recorded for twenty-eight occupational scales and two non- 
—o scales, masculinity-femininity, and occupational 
evel. 

4. The Kuder Preference Record profile, unrevised form. These 
profiles were not available for all of the twenty cases. 

5. The University Testing Bureau Individual Record Form—a 
questionnaire covering family background, work experience, 
recreational activities, occupational plans, health history, etc. 

6. A short statement of factual information obtained by the 
original counselor in the first interview with the student. No 
interpretative statements were included. 

7. A rating form—containing the three following statements: 

The student comes to you and says, “If you say ‘yes,’ I 
will attempt to become a(n) (insert occupational choice). If 
you say ‘no,’ I will not.” 

In this case you are forced to make a judgment. On the 
basis of the contents of this folder alone, would you say: 

, eee. sree (check one) 
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1. If you think someone might disagree with you on the above 
judgment, what do you think his basis for disagreement 
would be? / ee 

2. Why do you think this basis insufficient to change your 
judgment? 

The folders were then arranged in numerical order and 
given to each of the five counselors with the following instruc- 
tions: 

This is a necessary step in determining how judgments regarding 
the appropriateness of students’ vocational choices are made and 
how consistent these judgments are. Will you please read through 
the twenty folders in the order in which they are given to you and 
after you have obtained the necessary information as you do in the 
interview or prior to the interview, answer the questions which are on 
the mimeographed sheets in each folder. eee 

It is impossible to duplicate the exact interview situation without 
the student, but in order to provide as much of the interview atmos- 
phere as possible, the data observed and recorded by the original 
counselor have been included in the folder. Regard these observa- 
tions as factual rather than interpretive, i.e., they are exact state- 
ments of description rather than what the observer thought. Please 
be sure to answer all the questions. 

After each counselor had rated the twenty cases, a pro- 
cedure requiring from two to four hours, the folders were 
checked and put in their original order. New rating forms 


were inserted and the folders were given to the next counselor. 


Results 


Table 1 shows those cases judged by each counselor as hav- 
ing appropriate vocational choices and those having inappro- 
priate choices. The check after the number of a student indi- 
cates that the counselor judged his choice as appropriate. The 
absence of a check indicates that the counselor judged it as 
inappropriate. 

Of the 100 judgments, fifty-five were in the direction of ap- 
propriateness and forty-five in the direction of inappropriate- 
ness. Of the twenty students, ten had been judged by the 
original counselor as having appropriate vocational choices and 
ten as having inappropriate choices. Eighty-one of the 100 
judgments made by the five counselors agreed with the judg- 
ment previously made by the counselor who originally inter- 
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viewed the student. Analysis of the data in Table 1 yields a 
tetrachoric coefficient of .86 between the judgments made by 
the original counselor and the judgments later made by the 
five counselors. The results indicate that in judging the ap- 
propriateness of the vocational choices of groups of students, 
trained counselors are able to agree. 


TABLE 1 


Judgments of Counselors Concerning Appropriateness of the Vocational 
Choices of Twenty Students 








Counselors who later made judg- 
Cases judged as having appropriate choices ments of appropriateness 
by original counselor 
| A Ss eee | ae 








13755 


x x x x 

13972 x x x x 
14095 x x x x x 
14124 x x x x x 
14178 x x x x 
14377 x x x x x 
14423 x x x x x 
14442 x x x x x 
14485 x x x x x 
14642 x 





Counselors who later made judg- 
Cases judged as having inappropriate choices ments of appropriateness 
by original counselor 
1 2 i 38 ie 








13885 

13964 x x x 
14081 x 

14142 x x 
14396 x x 

14445 





Of the decisions originally made in the direction of appro- 
priate choice, 14 per cent were later judged as inappropriate. 
Of the decisions originally made in the direction of inappro- 
priate choice, 24 per cent were later judged as appropriate. 
This suggests that counselors tend to agree more upon judg- 
ments when students’ choices are appropriate than when they 
are inappropriate. Counselors are perhaps more willing to put 
their stamp of approval on the student’s plans than they are to 
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discourage him. If a doubt exists in the mind of a counselor 
regarding the appropriateness of a student’s vocational choice, 
he is more apt to decide the choice warrants a try-out than to 
decide it does not. These generalizations spring from clinical 
experience and the above data tend to substantiate them. 

The judgments of the majority of counselors (three or 
more) agreed with the original classification of appropriateness- 
inappropriateness in eighteen of the twenty cases. The only 
people who considered the choice of case 14642 appropriate 
were the original counselor in both his first judgment and later 
judgment, and the case reviewer. One counselor besides the 
original counselor and the case reviewer considered the choice 
of case 13964 inappropriate, but three counselors considered it 
appropriate. The results do indicate that in the great major- 
ity of cases, judgments of the five counselors agreed with the 
decisions reached by the original counselor and the case 
reviewer. 

Fourteen of the twenty cases had originally been inter- 
viewed by counselors who later served as judges in this study. 
It is doubtful if the original counselors remembered the cases, 
as all identifying data were removed at second presentation 
and a period of several months had elapsed since the original 
interview. Of these fourteen judgments, not one disagreed 
with the original decision. Even those two cases on whom the 
majority of counselors disagreed with the original counselor 
were consistently judged a second time by the original coun- 
selor. Here is evidence that a period extending from two to 
four months does not alter the judgments a counselor makes 
regarding the appropriateness of vocational choices and that 
counselors tend to arrive at the same judgment in the inter- 
view as they do by merely reviewing the case data and never 
seeing the student. These are essentially the results found by 
Super and Brophy (3), and it seems safe to generalize from 
them in the area of vocational guidance. 

Up to this point, the analysis of judgments concerning ap- 
propriateness and inappropriateness of vocational choices has 
provided information regarding the consistency of these judg- 
ments. Little has been shown regarding the actual judgment- 
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making processes themselves, however, and the factors con- 
sidered in these judgments have not been discussed. A more 
complete understanding of these judgments will be obtained 
through a careful consideration of some of these cases them- 
selves and the comments made by the counselors as they were 
making the judgments. Limitations of space prevent presen- 
tation of this material for all of the twenty cases. 

Case number 13755 was a seventeen-year-old boy who grad- 
uated from high school one month after he came to the Test- 
ing Bureau. His occupational choice was chemical engineer- 
ing, his father was dead, he had one eleven-year-old brother, 
and he said he would have to work about twenty-four hours 
a week while attending college. 

Test scores were as follows: 


Percentile 


Test pons Norm group 

oe scholarship 42 

A.C.E. 77 University freshmen 
Ohio Psychological 61 U.T.B. cases* 
Cooperative English 46 University freshmen 
Iowa Math. Training 57 Engineering freshmen 
Iowa Chemistry Training 87 Engineering freshmen 
Cooperative Physics 47 National—1 year high-school physics 
Cooperative Social Studies 88 S.L.A. freshment 
Minnesota Clerical—Numbers 54 General population 

Names 94 General population 

Finger Dexterity 54 General population 
Tweezer Dexterity 33 General population 
Spatial Relations 99 General population 
Revised Paper Form Board 88 Engineering freshmen 


Chapman-Cook Reading Test 64 S.L.A. freshmen 
Minnesota Personality Scale— 


Morale 14 S.L.A. freshmen 
Social 52 S.L.A. freshmen 
Family 90 S.L.A. freshmen 
Emotional 60 S.L.A. freshmen 
Economic Conservatism 17 S.L.A. freshmen 


* University Testing Bureau cases. 
+ Freshmen in the College of Science, Literature and the Arts. 


Strong Test scores were A on keys for chemist, farmer, 
carpenter, printer, mathematics and physical science teacher, 
forest service man; B+ on keys for dentist, engineer, Y.M.C.A. 
physical director, social science high-school teacher, office man; 
B on keys for production manager and accountant. Mascu- 
linity-Femininity percentile—82; Occupational Level percentile 
—2. Percentile scores on the Kuder Preference Record were: 
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Scientific, 98; Computational, 30; Musical, 8; Artistic, 86; 
Literary, 8; Social Service, 9; Persuasive, 44. 

The following statement of factual information was ob- 
tained from data contained in the interview notes of the coun- 
selor who originally counseled the student. 

He is a husky, rather ordinary appearing young man. He is a 
little crude in his approach but very friendly. His father is dead and 
he lives with his mother and younger brother. 

He will be totally self-supporting. He has saved about $100 from 
his paper route in the last three or four years and will continue to 
have a morning and evening route while going to college. 

He says he took his first two years in high school as a joke and as 
compulsory education. Then he realized he must work harder but 
was unable to fully compensate for his previous loafing. He seems 
well motivated. 

The original counselor and the case reviewer originally 
decided that the boy’s choice of chemical engineering was ap- 
propriate. In making the later judgments, four of the five 
counselors agreed that this choice was appropriate; one decided 
it was not. 

The dissenting counselor’s response to the first question 
concerning the basis for disagreement was as follows: 

They would stress the adequate ability and high-school achieve- 
ment factors, together with the A and B+ scores on the chemist and 
engineering key on the interest test. They would then suggest that 
the boy be given a chance to show what he could do. They would 
also stress the good tests of background in mathematics and chem- 
istry. 

In response to the second question, concerning his reasons 
for considering the above inadequate to change his judgment, 
he wrote: 

The discrepancy between H.S.R. and A.C.E. or Ohio seems to 
indicate under-achievement of long standing. The extremely low 
Occupational Level score and the problem of complete financial sup- 
port are not hopeful signs of staying power. The block of skilled 
trades interests on the Strong Test is vitally important, partially 
because of their rarity. 

Three of the other counselors mentioned the low high-school 
rank but did not appear to give it enough weight to have them 
change their judgments. One counselor thought a basis for 
disagreement might be found in the fact that it was too early 
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for the boy to make a choice as specific as chemical engineering. 
Two counselors specifically mention the boy’s motivation and 
appear to think that the fact that his achievement tests are 
better than his high-school rank improves his chances in the 
university. 

One counselor, rating the occupational choice as appro- 
priate, recognized these negative factors: 
Average mathematics test score 
Low high-school rank 
Low | Occupational Level score—“interests evidently imma- 
ture 
C on mathematician key of Strong Test 


Totally self-supporting 
Low grades in high-school mathematics 


Ae we 


We thus have two counselors who considered and listed the 
same factors, and yet one decided the choice was inappropriate, 
while the other wrote: 

The above is strong evidence to question his choice, but because 
of the positive factors which are also clearly indicated, I’d be inclined 
to give him the benefit of the try-out. 

The above counselor’s note concerning the Occupational 
Level score gives a suggestion concerning one possible source 
of this disagreement. This counselor evidently interprets the 
Occupational Level score as an expression of interest maturity 
which therefore might change as the student ages, while the 
first counselor vaguely interprets it as an index of academic 
motivation. 

Only one of the counselors approving of the occupational 
choice mentioned the financial problem, and none of them em- 
phasized it as being important. The original counselor recog- 
nized the financial problem in the interview and took steps to 
meet it. Although he realized the importance of this problem, 
he did not consider that the boy should stay out of engineering. 

This boy completed the first two quarters in the Institute of 
Technology with an honor point ratio of .42._ His grades were: 


College Algebra D 
Chemistry Cc, Cc 
Composition D, I (incomplete) 


Drawing D, D 
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He dropped out of school at the end of his second quarter 
and has not returned. 

Case number 13972 was an eighteen-year-old boy who grad- 
uated from high school six months before coming to the Testing 
Bureau and who was completing six months of post-graduate 
work in high school. His occupational choice was mechanical 
engineering, his father was crippled with arthritis and unable 
to work, he had two younger sisters, sixteen and eleven years 
old, he had work experience drafting on an N.Y.A. job, and 
would be totally self-supporting. 

Test scores were as follows: 


Percentile 
Test pees Norm group 
High school scholarship 98 
A.C.E. 76 University freshmen 
Ohio Psychological 78 U.T.B. cases 
Cooperative English 70 University freshmen 
Iowa Mathematics Training 97 Engineering freshmen 
Iowa Chemistry Training 17 Engineering freshmen 
Minnesota Clerical—Numbers 74 General population 
Names 96 General population 
Chapman-Cook Reading 20 S.L.A. freshman 
Minnesota Personality Scale— 
Morale 10 S.L.A. freshman 
Social 31 S.L.A. freshman 
Family 66 S.L.A. freshman 
Emotional 57 S.L.A. freshman 
Economic Conservatism 26 S.L.A. freshman 


Strong Test scores were: A on keys for chemist, production 
manager, farmer, carpenter, printer, mathematics and physical 
science teacher, accountant, office man; B+ on keys for engineer, 
forest service man; B on keys for dentist, personnel manager, 
social science high-school teacher, purchasing agent. Mascu- 
linity-F emininity percentile—76; Occupational Level percentile 
—22. 

The following statement of factual information was ob- 
tained from data contained in the interview notes of the coun- 
selor who originally counseled the student. 


The boy does not have much money. His father is disabled be- 
cause of arthritis. The boy has been working part-time for five 
months on a N.Y.A. job doing drafting work and making about $100 
amonth. He has had other odd jobs from time to time. 

He is intrigued with mathematics and doesn’t know much about 
the work of an actuary. He does not know that the training for 
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this type of work is essentially through business and not through 
mathematics. _ 

He has applied for a scholarship open to sons and daughters of 
World War veterans. 

He is socially retiring. 

The original counselor and the case reviewer decided that 
the boy’s choice of mechanical engineering was appropriate. 
In making the later judgments, four of the five counselors 
agreed that this choice was appropriate, one decided it was not. 

The dissenting counselor wrote: 


This is a loose judgment. It would actually depend upon a judg- 
ment of which field (Institute of Technology or actuarial) the boy 
wanted most. He would be handicapped by lack of chemistry [in 


high school]. 

Three of the other counselors recognize the boy’s expressed 
and measured interests in the business field and two of them 
suggest possible combinations of business and engineering. 
One of these two “mildly objects” that the boy hasn’t quite the 
personality type for executive or management work. Two of 
the counselors indicate that the financial problem might serve 
as a basis for someone disagreeing with their judgment of the 
choice as appropriate. Both say, however, they think the 
problem can be satisfactorily managed. One counselor men- 
tions the low Occupational Level scores but thinks this is over- 
balanced by the excellent achievement in high school. This is 
the same counselor who in the last case interpreted the Occu- 
pational Level score as an index of maturity. He is apparently 
using it here as an indicator of potential achievement! ‘This 
counselor also recognizes the low score on the chemistry test 
but discounts it because the boy has not had chemistry in high 
school. 

In general, there are no fundamental disagreements among 
the counselors regarding this case. They all tend to recognize 
that the boy has several potentialities and is a good college risk. 
Although one counselor indicates he would not encourage the 
occupational choice, he later qualifies this. 

This boy completed the first year in the Institute of Tech- 
nology with an honor point ratio of 2.11. His grades were: 
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Algebra A 
Trigonometry A 
Analytic Geometry B 
Chemistry B, B, C 
Composition A, B, B 
Drawing B, B, C 


He is now making satisfactory progress in his engineering 
course. 

Case number 14095 was an eighteen-year-old boy who grad- 
uated from high school the same month he came to the Bureau. 
His vocational choice was business, the occupation of his father. 
His test scores were as follows: 


Percentile 
Test a Norm group 
~— school scholarship 30 
A.C.E. 53 University freshmen 
Ohio Psychological 45 U.T.B. cases 
Cooperative English 49 University freshmen 
Iowa Mathematics Aptitude 64 University freshmen 
Iowa Mathematics Training 8 University freshmen 
Cooperative Natural Sciences 24 S.L.A. freshmen 
Cooperative Social Studies 87 S.L.A. freshmen 
Minnesota Clerical—Numbers 94 General population 
Names 89 General population 
Mechanical Assembly 56 General population 
Finger Dexterity 40 General population 
Tweezer Dexterity 86 General population 
Spatial Relations 86 General population 
Chapman-Cook Reading 70 S.L.A. freshmen 
Minnesota Personality Scale— 
Morale 93 §.L.A. freshmen 
Social 96 S.L.A. freshmen 
Family 31 S.L.A. freshmen 
Emotional 84 S.L.A. freshmen 
Economic Conservatism 53 S.L.A. freshmen 


Strong Test scores were: A on keys for personnel manager, 
real estate salesman; B+ on keys for social science high-school 
teacher, accountant, office man, sales manager, life insurance 
salesman; B on keys for production manager, Y.M.C.A. secre- 
tary, purchasing agent. Masculinity-Femininity percentile— 


76; Occupational Level percentile—66. Percentile score on the 
Kuder Preference Record were: Scientific, 42; Computational, 
79; Musical, 10; Artistic, 7; Literary, 62; Social Service, 60; 
and Persuasive, 99. 

The following statement of factual information was ob- 
tained from data contained in the interview notes of the coun- 
selor who originally counseled the student. 
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He is a young man of short stature, not too neatly dressed, has a 
rather informal manner in the interview. He is rather ordinary in 
appearance. He would like to be self-supporting while going to 
school. He has about $250 saved now and might earn enough before 
starting at the University to continue without working while in 
school. His father would help him but he dislikes asking his father 
for help. 

The father and mother were divorced about three years ago. The 
father is the president of a business. There are no other children in 
the family and the boy lives with his mother and gets along well with 
both parents. 

In high school he says he studied just enough to get by but says 
he realizes now that that was not so smart. 

The original counselor and the case reviewer decided that 
the boy’s choice of business was appropriate. In making the 
later judgment, all of the five counselors agreed that this choice 
was appropriate. Four of the five said they did not think the 
boy’s chances of graduating from, the University were good but 


their attitude is expressed by this counselor. 

I can’t see any basis for disagreement since the job is waiting for 
him when he is through with school. However, I do not think he’ll 
graduate from the University. 

Again in this case there is general agreement among the 
counselors. It is doubtful if the boy’s plans would have been 
influenced differentially by the counselors as they were all 
ready to approve of his vocational choice. This case is quite 
clear-cut. 

This boy entered the College of Science, Literature and the 
Arts and at the end of his first quarter had an honor point ratio 
of .00. It is doubtful if his academic “flop” will seriously inter- 
fere with his vocational adjustment. His grades were: 


Composition—cancelled 
Economics 

Political Science C 
History F 


He did not return to the University after his first quarter. 
Case number 13885 was an eighteen-year-old boy who came 
to the Testing Bureau the month he graduated from high 
school. His father was asalesman. The boy had one younger 
sister. The family was going to finance his college education. 
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He had no work experience outside of working for his father 
and his vocational choice was advertising. 
The test scores were: 


Percentile 
Test por Norm group 
ner school scholarship 30 
A.C.E 8 University freshmen 
Ohio Psychological 10 U.T.B. cases 
Cooperative English 2 University freshmen 
Iowa Mathematics Aptitude 7 University freshmen 
Iowa Chemistry Aptitude 19 University freshmen 
Cooperative Natural Science 62 S.L.A. freshmen 
Cooperative Social Studies 28 S.L.A. freshmen 
Minnesota Clerical—Numbers 63 General population 
Names 42 General population 
Mechanical Assembly 24 General population 
Finger Dexterity 29 General population 
Tweezer Dexterity 46 General population 
Spatial Relations 32 General population 
Manual Dexterity 13 General population 
Revised Paper Form Board 15 Engineering freshmen 
Chapman-Cook Reading 4 S.L.A. freshmen 
Minnesota Personality Scale— 
Morale 30 S.L.A. freshmen 
Social 9 S.L.A. freshmen 
Family 10 S.L.A. freshmen 
Emotional 3 S.L.A. freshmen 
Economic Conservatism 9 S.L.A. freshmen 


Scores on the Strong Interest Test were: no A ratings; B+ 
on keys for farmer, purchasing agent, real estate salesman; 
B on keys for personnel manager, office man, president of a 
manufacturing concern. Masculinity-Femininity percentile— 
57; Occupational Level percentile—40. Percentile scores on 
the Kuder Preference Record were: Scientific, 57; Computa- 
tional, 45; Musical, 1; Artistic, 58; Literary, 15; Social Service, 
17; Persuasive, 52. 

The following statement of information was obtained from 
the data contained in the interview notes of the counselor who 
originally counseled the student. 

He is a very immature boy and his mother came with him the 


first day. He gives the impression of not knowing much about any- 
thing. He doesn’t react favorably to General College. 


The original counselor and the case reviewer originally 
decided the boy’s choice of advertising was inappropriate. In 
making later judgments, all of the five counselors agreed that 
this choice was inappropriate. Three of the judges could see no 
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reason why anyone would disagree with them. Two of the 
counselors suggest he might be able to handle a lower level job 
of advertising. 


They might think he could do a low-grade type of advertising 
(show card writing, window displays) which may be what he means 
by advertising man. . . . He could never get the degree from the 
advertising sequence in the Business School because of various rea- 
sons. I doubt whether he’d be much good even at a low level of 
advertising in view of the poor manipulative skills and ability to work 
in spatial relationships. 


The judges appeared to have very little difficulty in arriv- 
ing at a decision on this case. He entered the General College 
and at the end of the first year took three comprehensive ex- 
aminations, receiving a C in Social Civics, an F in Vocational 
Orientation, and an F in Individual Orientation. His course 
grades were: 


Individual Orientation 
Current History 
Government Studies 
United States in World Civilization 
Vocational Orientation 
Human Biology 

Oral Communication 
Psychology 

Physical Science 
Human Development 
Economics 


QANBWAQNDAewwO 
Q AWA 


Case number 13964 was a seventeen-year-old boy who came 
to the Bureau the month he graduated from high school. His 
father was a car and truck mechanic and there were two 
younger brothers and a younger sister in the family. He had 
no unusual work experience and his vocational choice was 
architecture. Test scores were as follows: 


Percentile 
Test prommas Norm group 

High school scholarship 99 
A.C.E. 53 University freshmen 
Ohio Psychological 67 U.T.B. cases 
Pressey Classification 84 General population 
Cooperative English 23 University freshmen 
Iowa Mathematics Training 91 University freshmen 
Iowa Chemistry Aptitude 80 University freshmen 
Meier-Seashore Art 86 

(excep- 


tional) 
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Minnesota Clerical—Numbers 73 General population 
Names 47 General population 
Revised Paper Form Board 83 General population 
Chapman-Cook Reading 13 §.L.A. freshmen 
Minnesota Personality Scale— 
Morale 13 S.L.A. freshmen 
Social 69 S.L.A. freshmen 
Family 42 S.L.A. freshmen 
Emotional 99 S.L.A. freshmen 
Economic Conservatism 32 S.L.A. freshmen 


Scores on the Jnterest Test were: A on keys for printer, 
mathematics and physical science teacher; B+ on keys for far- 
mer, personnel manager, accountant, office man; B on keys for 
carpenter, forest service man, Y.M.C.A. physical director, 
Y.M.C.A. secretary, social science high-school teacher, Mas- 
culimty-Femimmnity percentile—30; Occupational Level per- 
centile—22. Percentile scores on the Kuder Preference Record 
were: Scientific, 50; Computational, 65; Musical, 63; Artistic, 
90; Literary, 35; Social Service, 3; and Persuasive, 30. 

The following statement was obtained from the data con- 
tained in the interview notes of the counselor who originally 
interviewed the student. 


There is a financial problem here, to some extent. He has ap- 
plied for N.Y.A. assistance. He claims he enjoys art very much and 
has done a great deal of poster work and layout work. He has a 
chance for a scholarship at the Institute of Art but will not accept it. 


The original counselor and the case reviewer decided the 
boy’s choice of architecture was inappropriate. In making the 
later judgments, two of the counselors agreed that the choice 
was inappropriate, three decided it was not. All the counselors 
rating the choice as appropriate noticed the absence of mea- 
sured interests but made the following statements. 

“No confidence in Strong for architecture.” “Kuder test 
shows ‘artistic’; has art skills; has necessary ability. The 
Strong test may be in error.” “The Strong is against me but 
his experience (making posters) is good enough to lead me to 
let him try it. The other interest test supports his choice.” 

One of the counselors rating the choice inappropriate cited 
in support the great concentration of skilled trades interest, 
the low Occupational Level score, the poor home and cultural 
background, and the financial problem. The superior high- 
school rank was discounted in light of the relatively poor school 
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the boy attended. The other counselor rating the choice as 
inappropriate admitted the boy probably had enough ability 
to get the degree and that the choice might be appropriate from 
the standpoint of job opportunities. He added, however: 

He probably is not outstanding enough in ability to make his liv- 
ing in this field, which offers limited opportunities to all but the very 
exceptional person. In view of the lack of Strong’s measured inter- 
ests, the low level of occupational aspiration, I’d say he should prob- 
ably get mechanical drafting training or commercial art training. 

This counselor, who is now interpreting the Occupational 
Level score as a measure of occupational aspiration, is the same 
one who previously interpreted it as a measure of interest ma- 
turity! This boy did not enter the University. 

In this case, the basis for disagreement is quite clear-cut. 
Two of the counselors, chiefly on the basis of the interest test, 
would discourage the boy from entering architecture. The 
other three would discount the lack of measured interests and 
not discourage the boy. A tendency has also been found for 
some of the counselors to consider some of the keys of the 
Strong Test valid and some not. The factors which help the 
counselors determine which keys are valid have not been 
identified. 

Case number 14081 was a nineteen-year-old boy who came 
to the Bureau one year after graduating from high school. He 
will have to help finance his college education. His vocational 
choice was metallurgical engineering. 

The test scores were as follows: 


Percentile : 

Test peice Norm group 
High school scholarship 13 
A.C.E. 47 —_ University freshmen 
Miller Analogies, Form B 68 Education freshmen 
Ohio Psychological 21 U.T.B. cases 
Cooperative English 3 University freshmen 
Iowa Mathematics Aptitude 34 University freshmen 
Iowa Mathematics Training 32 University freshmen 
Iowa Chemistry Aptitude 68 University freshmen 
Iowa Chemistry Training 65 University freshmen 
Cooperative Social Studies 85 S.L.A. freshmen 
Cooperative Contemporary Affairs 57 S.L.A. sophomores 
Minnesota Clerical—Numbers 34 General population 

Names 29 General population 

Chapman Cook Reading 5 S.L.A. freshmen 


Minnesota Personality Scale— 
Morale 22 S.L.A. freshmen 
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Social 47 S.L.A. freshmen 
Family 66 S.L.A. freshmen 
Emotional 57 S.L.A. freshmen 
Economic Conservatism 49 §.L.A. freshmen 


Scores on the Strong Test were: A on keys for engineer, 
chemist, farmer; B+ on no keys; B on keys for architect, mathe- 
matician, printer, mathematics and physical science teacher, 
purchasing agent. Masculinity-Femininity percentile—65; 
Occupational Level percentile—66. Percentile scores on the 
Kuder Preference Record were: Scientific, 70; Computational, 
91; Musical, 50; Artistic, 55; Literary, 5; Social Service, 9; 
Persuasive, 60. 

The following statement of information was obtained from 
the data contained in the interview notes of the counselor who 
originally interviewed the student. 

He lives with his mother and sister, both of whom are working. 
His father is dead. He applied for admission last year but was re- 


ferred to the General College. He did not wish to go there so he did 
not come to school. He has an unusually strong vocational fixation. 


The original counselor and the case reviewer decided the 
boy’s choice of metallurgical engineering was inappropriate. 
In making the later judgments, three of the counselors agreed 
with this decision while two counselors judged the choice as 
appropriate. Two of the counselors rating the choice as inap- 
propriate said they would expect no disagreement. The other 
counselor rating it as inappropriate said that, in the light of 
the boy’s apparent strong drive for engineering, and “with the 
equivocal results on the Strong’s,” some might claim he should 
be given an opportunity in engineering. This counselor does 
not expound the mentioned equivocalities of the Strong Test. 
He decides, however, that, without an interview, the above 
factors cannot be given much weight. Both counselors rating 
his choice as appropriate recognize the boy’s limited abilities 
and one mentions his relatively weak background in mathe- 
matics and chemistry. One of the counselors writes: 


They would question his ability. His vocational choice has 
changed since he left high school. That might help him to work to 
capacity. Then I think he could make it. . . . I would improve his 
motivation, I hope, and if so, he’d make it. He lacks verbalistic 
skills. This would not be such a handicap to him in the Institute 
of Technology. 








a 








~~ ow 


JUDGMENTS IN COUNSELING 53 


This boy did not register in the University. 

In this case the basis for disagreement is again quite clear. 
The boy has interests congruent with his choice but abilities 
and a background that are not encouraging. All the counselors 
apparently recognized these factors, but three of them decided 
engineering was not a satisfactory choice, while two of them 
decided to take a chance, not place too much weight on the 
ability factor, depend on the interest and motivational factors, 
and let the boy try it. 


Summary of Analysis of Judgments 


The preceding discussion has covered much territory and 
many inferences have been drawn. Inferences drawn from the 
six cases discussed and the fourteen remaining cases are not 
conclusions based upon experimental results but are generaliza- 
tions based upon observations of only a few cases. Often they 
are merely clinical hypotheses that should be investigated. 
Some of them are nothing more than verbalizations of con- 
ditions generally known to exist but often not explicitly 
recognized. 

1. In making judgments regarding the appropriateness of 
students’ vocational choices, trained counselors agree with the 
original judgment 84 per cent of the time. The tetrachoric 
coefficient between judgments made by different counselors 
is .86. 

2. The majority of five trained counselors agreed in making 
judgments regarding the appropriateness of students’ voca- 
tional choices upon the basis of the case notes with the decisions 
of the counselor who originally counseled the student and the 
case reviewer 90 per cent of the time. 

3. In fourteen out of fourteen cases, the counselor who 
originally counseled the student and judged the appropriate- 
ness of his vocational choice at that time made the same judg- 
ment from the unidentified case folder several months later. 

4. Counselors tend to approve of vocational choices oftener 
than they disapprove of them. 

5. The Occupational Level score has been interpreted as a 
measure of interest maturity, as a measure of motivation, as 
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an index of occupational aspiration, and as a cause for poor 
achievement in high school. 

6. Some counselors are reluctant to have a student of high 
ability enter business even if other factors suggest the advis- 
ability of such a choice. 

7. When both measured and expressed interests are in busi- 
ness, counselors will seldom discourage a student from entering 
business. They may disagree on the level of training desired. 

8. If ability and interest factors indicate success in an occu- 
pation, counselors tend to think meager informational back- 
grounds can be compensated for. 

9. The appropriateness of a student’s choice cannot easily 
be agreed upon when the occupational requirements, duties, 
and status are poorly defined. 

10. The greater the apparent contradiction between the 
student’s test scores, the greater will be the disagreement re- 
garding the appropriateness of his vocational choice. 

11. Some counselors interpret more rigorously scores on 
some scales of the Strong Test than they do scores on other 
scales. 

12. Counselors do generalize results of the Strong Test to 
occupations for which there are no keys. Often they disagree 
upon the probable pattern people in a given occupation would 
obtain. 

13. Lack of ability and absence of measured interests in an 
occupation almost always lead counselors to disapprove of a 
student’s choice of that occupation. 

14. If a student’s aptitudes are too low, a counselor will 
disapprove of his vocational choice even if he has measured 
interests in that occupation. 

15. Relatively little attention was paid to personality test 
scores in judging the appropriateness of vocational choices. 
Much attention was given to tests of ability, information, inter- 
ests and high-school achievement. 

16. Interest tests are used in determining occupational 
areas; ability and information tests and high-school achieve- 
ment are used in determining levels of training. 

17. Counselors make decisions regarding the appropriate- 
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ness of vocational choices based upon generalizations which are 
often without support. 

18. Sometimes when counselors consider the same evidence 
in making judgments on the appropriateness of vocational 
choices, they will not reach the same conclusion. They some- 
times place different weights upon tests at different times, 
interpret them differently, and disagree with each other regard- 
ing these interpretations. 

Evaluation of these results might cause one to question if 
counseling based upon such judgments can be more than syste- 
matic guess-work. In light of the statistical results, however, 
it must be concluded that regardless of the discrepancies in 
interpretations and regardless of some of the peculiar logic used 
by the counselors, the final outcomes at which they arrive do 
agree. We must remember that in the above cases the coun- 
selors were forced to make a decision. In many actual inter- 
views, the counselor can suggest try-outs of various kinds that 
provide additional information in terms of actual success or 
failure before a decision has to be made. Often the counselor 
cannot make a decision and does not have to put himself on a 
limb as he did here. The student is also an important factor in 
arriving at a final decision in the actual counseling situation. 
The responsibility for making the decision is eventually his, 
and counseling which is more “non-directive” in character may 
not force the counselor to make a decision at all. As long as 
the counselor is to present test data to the student, however, 
he will most likely have to interpret it as either supporting or 
not supporting the student’s choice or else interpret it as being 
completely irrelevant. 
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THE DEFINITION OF SOCIAL EFFECTIVENESS AND 
LEADERSHIP THROUGH MEASUREMENT* 


HENRY C. LINK 
The Psychological Corporation 


ENOUGH EXPERIMENTAL work has now been done to permit 
a definition of social effectiveness and leadership, and to justify 
such conclusions as the following: (1) Social effectiveness con- 
sists of certain habits and skills which can be acquired by 
practice; (2) Leadership is an aspect of social effectiveness— 
leaders are not merely born, they are persons who have de- 
veloped social effectiveness to an unusual degree; (3) That 
“only a few are born to be leaders, the great majority must be 
followers,” is a fallacy—most people can develop and use skills 
of leadership if they will. The basis for these statements and 
a set of guides for the development of leadership and social 
effectiveness will be presented here. 


Measurement 


The scientific definition and explanation of human traits 
depends upon the development of tests which will measure 
those traits. The wide variety of measuring instruments de- 
veloped in recent years under the broad heading of personality 
tests has contributed much to our understanding of social 
effectiveness. These tests, or scales, or inventories, center 
around the concept of personality as the social-stimulus value 
of a person. Whereas recently there has been a trend to make 
the term, personality, synonymous with person or individu- 
ality, measurement has developed according to the more spe- 
cific concept of personality in terms of social effectiveness. 


* This paper was prepared for PSYCHOLOGY: SCIENCE AND PRACTICE, 
edited by E. R Henry and Douglas H. Fryer, publication of which by Farrar and 


Rinehart has been delayed by the war. Publication of this paper is with their 
permission. 
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From the many excellent personality tests, the following 
have been selected to illustrate certain positive and negative 
aspects of social effectiveness: The Moss Social Intelligence 
Test (1930), because it illustrates the difference between social 
knowledge and social effectiveness; The Allport Ascendance- 
Submission Scale (1928), because it illustrates a widespread 
belief that people fall into two broad classifications, those who 
dominate and those who are dominated; The Vineland Social 
Maturity Scale (Doll, 1936), because more than any other test 
or inventory it exemplifies the concept of social effectiveness as 
the acquisition of specific habits and habit patterns through an 
orderly process of learning; and the Link Personality Quotient 
Test (1935), because it is the only test the validity of which 
has yet been established in terms of leadership. 

Social Intelligence.—Social intelligence is not synonymous 
with social effectiveness. An investigation of practically every 
experiment in which the results of personality tests were com- 
pared with those of intelligence tests, tests of academic achieve- 
ment, years of education, or records of scholastic standing, 
reveals the almost complete absence of significant correlation 
between them (Link and Roslow, unpublished); that is, mea- 
sures of social behavior do not give correlations with measures 
of intelligence or academic achievement. On the other hand, 
significant inter-correlations are found among nearly all of the 
various tests of personality, such as extraversion-introversion, 
ascendance-submission, sociability, sense of inferiority, emo- 
tional stability. This broad experimental result makes inevi- 
table the conclusion that personality tests measure a common 
factor quite distinct from that measured by all forms of intelli- 
gence and academic achievement tests. The I.Q. (intelligence 
quotient) or the A.Q. (achievement quotient) measures one 
aspect of individuality, the $.Q. (social quotient) or the P.Q. 
(personality quotient) measures a quite different aspect. 

This difference between intelligence and knowledge on the 
one hand, and habits of social behavior on the other, becomes 
dramatically clear with reference to the Social Intelligence Test. 
This test correlates not with the personality tests but with the 
intelligence tests. This test emphasizes an understanding or 
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knowledge of social behavior, whereas the emphasis in the All- 
port A-S Scale, the Vineland Social Maturity Scale, the Link 
P.Q. Test, is upon specific social habits. The former stresses 
theory and judgment, the latter practice. Social effectiveness 
consists of a peculiar collection of habits and skills, the common 
denominator of which is their practical effect on other people. 

Ascendance and Submission.—The A-S Scale codifies a con- 
cept of social effectiveness quite widely accepted both by scien- 
tific psychologists and the public. According to this concept, 
some people dominate others in their social relationships, while 
some are submissive, bashful, or retiring. This idea was popu- 
larly expressed in Scott’s pioneer book on influencing men in 
business (1911) and is also exemplified in another early book 
by Strong on the psychology of selling life insurance (1922). 

The ascendance-submission concept of social effectiveness, 
crystallized by the A-S Scale, is carried over into the Bern- 
reuter Personality Inventory and a number of other modern 
personality scales. The use of such scales implies that a person 
must either dominate others or be dominated by them. This 
fits in with the popular fallacy that people naturally divide into 
two groups, leaders and followers. To be sure, test scores show 
many people at the happy medium, neither ascendant nor sub- 
missive. Nevertheless, the implication is that both extremes 
are essential. We are here confronted by two aspects of psy- 
chology, sometimes called pure and applied psychology. One 
is the impersonal science of people as they are, the other is the 
science of people as they ought to be. According to the first, 
many people simply are submissive and many are dominant, 
and these are the cold facts. The second emphasizes the study 
of people’s capabilities and tries to establish standards or ideals 
for these capacities. In the light of such tests and experiments, 
a definition of social effectiveness in terms of those who domi- 
nate and those who are dominated, those who are leaders and 
those who are not, is inadequate. 

Social Maturity—The Vineland Social Maturity Scale is 
unique in the extent to which it embodies the measurement of 
social effectiveness as a result of learning. Its construction 
makes this clear. Practically all of its 117 items refer to spe- 
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cific habits and habit patterns graduated according to their 
complexity into 17 age periods. All of these habits are of a 
kind which can be or must be acquired by practice. The more 
of them the individual acquires, the more socially mature he 
becomes, no matter what his chronological age. However, the 
grouping of habits by ages implies that the normal person will 
acquire the habits characteristic at his age. There is no impli- 
cation of social dominance or submission, except in so far as the 
person who has acquired these habits well may be superior to 
the person who has not learned them. 

This scale is unique also in the extent to which it consists 
exclusively of objective habit or behavior items, at least in 
intent. Unlike so many personality tests and scales, it asks no 
questions about how the individual feels, whether he is ever 
troubled with a sense of inferiority or whether his feelings are 
easily hurt. Social maturity is defined entirely in terms of 
overt behavior, and not in terms of ambiguous introspective 
responses to subjective questions. Through this scale Doll 
almost seems to say: “If a person will take care of his habits, 
his feelings will take care of themselves.” If this was not Doll’s 
intention, it certainly was that of the author of the P.Q. Test, 
in which the items are almost entirely habits and activities, and 
where such subjective traits as emotional stability, sense of 
inferiority, of security, and of social acceptance were deliber- 
ately omitted. 

A person’s feelings or emotions as a result of social situations 
are unquestionably important. However, both psychological 
theory and the trend in the development of tests and in clinical 
work justify the conclusion that feelings of social inadequacy 
leading to a general emotional instability are not the cause of 
social impotence. They are the result of failure to acquire 
adequate social skills. Therefore, while the emotions of frus- 
tration may give us broad clues to the problems of social compe- 
tence, the achievement of social effectiveness must be defined 
in terms of the habits and skills which make it possible. 

Doll’s Scale is not divided into traits, as are many person- 
ality tests. Nevertheless, some of the items in his scale include 
such a complex range of habits that they might almost be said 
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to represent a unit trait. For example, the item, “assumes 
personal responsibility,” may well include such a net-work of 
habits as would justify the trait description of self-reliance. 
In fact, most of the traits which other tests make explicit, plus 
a good many more, are implicit in the items of the Social 
Maturity Scale. 

There is one important exception, and that is the collection 
of habits which have to do with adjustment to the opposite sex. 
Nowhere in this scale is the specific and distinctive character 
of these habits recognized. On the other hand, clear recogni- 
tion is given to the importance of habits and skills which con- 
tribute to social effectiveness by enabling a person to be inde- 
pendent of people, to get along without them. In children this 
consists of being able to dress alone, to eat without help, to go 
places alone. In adults it consists of such items as “creating 
own opportunities” and “systematizing own work.” The im- 
portance of such habits in terms of social effectiveness is so 
obvious that it is easily overlooked. For instance, how effec- 
tive, socially, could a healthy adult be who had never learned 
to dress himself? On a higher level, this fact is expressed by 
Emerson’s epigram: “The test of true friendship is the ability 
to do without it.” A person who is entirely dependent on his 
friends, like an adult who has never learned how to get along 
without his mother, is limited in his social effectiveness. 

The person interested primarily in the practical problem 
of becoming more effective socially would do well to use the 
Social Maturity Scale as a guide. From the standpoint of 
scientific psychology some of its details are open to criticism. 
Nevertheless, it represents one of the soundest attempts to 
measure social effectiveness thus far. The next great scientific 
task is that of delineating the habits of social effectiveness with 
a curriculum and series of texts for instruction comparable to 
those in the academic field today. Doll’s Social Maturity Scale 
points the direction of this development. 

The P.Q.—The Personality Quotient Test was constructed 
to express the definition that: “Personality is measured by the 
extent to which the individual has acquired habits and skills 
which interest and serve other people” (3). It might just as 
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well have been given some such name as Social Effectiveness 
Quotient Test, since it is concerned entirely with habits and 
skills in this category. These habits are classified in four groups 
in the test, representing the following four traits: (1) habits of 
social initiative; (2) habits of self-determination; (3) habits 
of economic self-reliance; (4) habits of adjustment to the oppo- 
site sex. The title, P.Q. Test, was chosen partly to emphasize 
the fact that these habits are the result of learning, and partly 
to emphasize the sharp contrast with the I.Q. Experiments 
with many personality tests, as well as with the P.Q. Test, have 
shown that the habits of an effective personality or a socially 
effective person were in a category quite distinct from the 
habits of scholastic intelligence and achievement. This fact 
was confirmed in the nation-wide experiment to validate the 
P.Q. Test (3,8). 

Leadership is a manifestation of social effectiveness. This 
was assumed when the P.Q. Test was validated with refer- 
ence to the criterion, leadership. Leaders, for the purpose of 
the experiment, were high-school students who had been elected 
by their classmates to positions of leadership, not leaders ap- 
pointed by teachers or school officials. They were the class 
officers, officers of the General Organization and other school 
societies, editors and managers of the school papers, and cap- 
tains and managers of athletic teams, school band and orchestra, 
glee club, and other groups. The non-leaders were those who 
held none of the positions of leadership. The leadergroup was 
found to have a significantly higher P.Q. than the non-leader- 
ship group. Therefore, the P.Q. Test measures social effective- 
ness in terms of leadership. 


Leadership 


This concept of social effectiveness which we have been 
developing carries us a step beyond that of social maturity in 
terms of the status quo. It introduces a qualitative factor, 
namely: what habits and skills contribute more than others 
toward social competence and leadership? Accordingly, much 
of the experimental work with the P.Q. Test has concerned 
itself with item analyses and evaluations of the various habits 

















SOCIAL EFFECTIVENESS AND LEADERSHIP 63 


and activities. The following guides for the development of 
leadership and social effectiveness have been deduced from 
these and other investigations. 

Social Contact.—Social effectiveness cannot be developed 
in a social vacuum. One learns the skills of serving others by 
working and playing with them, not by remaining aloof. Per- 
sons who take part in community affairs, or who have been 
active members of a Y.M.C.A. or Y.W.C.A., dramatic club, the 
Scouts, or other organized groups, were found to have a higher 
P.Q. than those who had not. The frequent and often sneering 
rejection of group activities is eloquent proof that individuals 
can deliberately choose not to develop the skills of leadership. 
Parents who do not believe in letting their children do as they 
please, but who, by example and discipline, influence them to 
join the proper groups, are at least beginning their children on 
the path toward leadership. 

Organized Groups——Highly organized and competitive 
groups do more to develop leadership than do loosely organized 
or casual groups. The habits of teamwork and good sports- 
manship are the very foundations of social competence and 
leadership. One question of the P.Q. Test is: “Which of the 
following have you engaged in frequently in season,—baseball, 
tennis, bridge, badminton, hockey (a list of 20)?” Those who 
had engaged in 6 or 7 on this list usually had a higher P.Q. than 
those who had participated in only 1 or 2. The next question 
is: “In which of these did you practice hard and regularly so 
that you would become good enough to enter a contest?” Such 
practice contributes even more toward a high P.Q. than does 
casual participation. Among young people the greatest single 
influence in the development of leadership was intensive par- 
ticipation in competitive games and sports—however, not in 
one but in several. 

Prominent in this list are orchestras, glee clubs, and choirs. 
Few activities require more intensive practice and team-work 
than an orchestra. Not only must the individual learn to play 
his own instrument adequately, he must learn to play it in 
harmony with twenty or thirty others. One sour note may 
destroy the entire effect. The best violin becomes the first 
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violin, a leader, and every competent player may become the 
leader at times with a solo. 

Private Practice——The practice of some social skills in 
private is essential to the development of leadership. The per- 
son who spends day after day practicing the piano in solitude 
is developing a skill which may transform self-distrust into 
social confidence. Almost any skill which one develops to the 
point of competence may give him or her a sense of confidence’ 
and a degree of leadership. Nor does it have to be a skill in 
music, art, or literature. The more homely arts, such as cook- 
ing, knitting, and sewing, telling stories, gardening, being handy 
with tools, if developed to the point of superiority, can all con- 
tribute toward social effectiveness, even to leadership. Nearly 
every person can acquire some skill to the point where he excels 
in the ability to interest and serve others. 

Economic Independence.—The development of financial 
independence is indispensable to leadership. The habits of 
doing socially useful work, as represented by the trait of eco- 
nomic self-reliance in the P.Q. Test, are of basic importance. 
Aside from the experimental and clinical evidences for this con- 
clusion, it seems only natural that the person who leads others 
and upon whom others depend, should be independent and self- 
supporting himself. 

Opposite Sex.—Social effectiveness includes habits of deal- 
ing with the opposite sex. Psychological practice shows that 
there are some individuals who live in only one half of the social 
world, either the world of men or the world of women. They 
have developed emotional and mental barriers which keep them 
from dealing effectively with members of the opposite sex even 
in the most simple social situations. Such a barrier is likely 
to exist whenever an individual has failed to develop, through 
practice, some of the elementary habits of playing or working 
with members of the opposite sex. Many of these habits, like 
social dancing, are obviously of a very specific sort. However, 
even walking with, talking with, and telephoning to members 
of the opposite sex are found to be specific habits which must 
be and can be cultivated by themselves. Specific habits of 
interesting and serving members of the opposite sex are sharply 
defined elements in social effectiveness. 
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Bodily Movement.—Bodily movement is the common de- 
nominator of the activities which develop social effectiveness. 
If one examines the activities mentioned above, or the items 
which make up the Social Maturity Scale and P.Q. Test, it will 
be seen that all of them, whether it be playing the piano alone, 
playing in an orchestra, working for pay, or playing in a base- 
ball game, involves physical movement. The very word, 
leader, implies movement and action. The leader is one who 
moves in advance of his followers, one who must. make unusual 
exertions in their behalf. In terms of our definition of social 
effectiveness, he has won his position of leadership by his ability 
to interest and serve others. In so far as he has become the 
servant of all he may become the master of all. 

The common denominator of those pursuits which hinder 
the development of leadership is the absence of bodily move- 
ment, the absence of creative exertion. In this classification 
fall those time-consuming pursuits in which the individual 
merely sits and takes things in—the movies, the radio, casual 
reading, and just plain sitting. 

Lead-led.—Leaders must learn to be good followers most 
of the time. The condition of becoming a leader is the acqui- 
sition of skills which make one a good follower, a good team- 
mate. For every situation in which a person acquires these 
skills to the point of leadership, there are many more situations 
in which his social effectiveness depends on the skills of being 
a good follower. A study of leaders and non-leaders (10) in 
which 40 outstanding leaders and 40 non-leaders were selected 
in each of three high schools showed that the leaders partici- 
pated in an average of 6.8 activities compared with 1.7 activi- 
ties for the non-leaders. The most frequent extra-curricular 
activities among leaders were competitive athletics. Moreover, 
the leaders had over twice as much spare time as did the non- 
leaders, in spite of the fact that they engaged in four times as 
many extra-curricular activities. The authors attributed this 
to the fact that non-leaders frittered away much of their time 
and spent more time in reading and solitary activities whereas 
the leaders used all their time in a better organized and more 
efficient fashion. The participation in highly organized activi- 
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ties had brought about a greater integration in their lives gen- 
erally. “The fact that the leaders participate in games and in 
attending parties,” say the authors at one point, “is highly sig- 
nificant. In games the leader gains more experience with 
people, and this experience is useful to him in leadership.” 

Especially interesting is the light cast by this study on the 
oft-made remark: “We cannot all be leaders; some of us must 
be followers.” This study showed that the leaders were also 
the good followers, whereas the non-leaders were the poor fol- 
lowers. That is, a leader might be captain or top man in one 
activity or two, but was merely a member of the team or squad 
in his other 5 or 6 activities. In other words, the leaders were 
really followers in 5 or 6 activities, whereas the non-leaders were 
followers in only 1 or 2, or none. Thus, conspicuous leadership 
in one activity was based on having become a well-disciplined 
follower in several activities. The individuals chosen by their 
fellows to be leaders were tolerated as leaders because they were 
good followers. 

Citizenship 


The critical problems of citizenship so sharply illustrated by 
current perplexities over juvenile delinquency give the above 
findings unusual importance. In so far as good citizenship can 
be developed through education, these findings demonstrate the 
necessity of an almost revolutionary change in the present edu- 
cational system. This change may be described briefly by say- 
ing that many of the compulsory elements of education should 
be made optional and many of the optional elements made com- 
pulsory; that is, the extra-curricular organized group activities 
should be made part of the regular curriculum for which credit 
is given, and many of the present required subjects made extra- 
curricular. 

Intelligence and knowledge are necessary but, as we have 
seen, are by no means sufficient. In fact, there is no correlation 
today between social intelligence and social effectiveness. 
Effective citizenship depends on habits of action in organized 
groups, where most individuals are good followers most of the 
time but also good leaders some of the time. The individuals 
who learn the habits of good citizenship in the smaller units 
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such as those enumerated under the heading, organized groups, 
thereby acquire the basic skills required for effective participa- 
tion in the larger units of a democracy. 
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A REPORT ON SCHOLARSHIP EXAMINATIONS 
GIVEN IN LATIN AMERICAN COUNTRIES 
FOR THE SELECTION OF STUDENTS TO 
BE TRAINED IN METEOROLOGY 


ALBERT V. CARLIN 
United States Weather Bureau 
and 


FREDERIC M. LORD 
United States Civil Service Commission 

In Aucust, 1942, work was begun on the planning of an 
Institute of Meteorology in Colombia under the joint auspices 
of the United States Weather Bureau, the Office of Inter-Ameri- 
can Affairs, the Defense Supplies Corporation, and the Division 
of Cultural Relations of the State Department. 

The Institute was to award scholarships to 200 Latin 
American young men for training in Weather Observations, 
primarily, preparing them for positions in the meteorological 
services of their own countries or of Latin American Airlines. 
Courses in meteorology, and refresher courses in physics, 
mathematics, and English were also to be presented. The 
Institute was to be staffed partly by U. S. Weather Bureau 
personnel and partly by Latin American instructors. 

The long-range objectives of the Institute of Meteorology 
in Colombia were threefold: 

“1. To increase the safety and regularity of air transpor- 

tation. 

“2. To pave the way for improvements in agriculture 
through better crop planning and forecasting. 

“3. To provide greater facilities for flood forecasting, pub- 
lic health work, and improved operation of public 
utilities through advance knowledge of weather.” 

In the planning of the program the question inevitably arose 
as to how young Latin-American men were to be selected for 
69 
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the training in the Institute. The men selected had to meet 
the following requirements: 

“1. They must have a knowledge of physics and mathe- 
matics, or they must at least show an aptitude for 
the study of physical science. 

“2. They must have a knowledge of English, or at least 
have an aptitude for learning languages.” 

The requirement of a knowledge of English arose from a 
further aspect of the planning of the Institute. After the six- 
month course of the Institute was completed, 40 of the better 
qualified students were to be brought to the United States and 
provided with advanced meteorological training at one of our 
universities. Thus, though it was not necessary to select only 
those who had a good knowledge of English, it was desirable to 
have as many so qualified as possible, from whom 40 might 
later be chosen for advanced training in the United States. 

The young men were to be selected from each of the Latin 
American countries, the number from each country being pro- 
rated according to population, area, and number of airline- 
miles. 

The first method of selection that presented itself was to 
base selection on achievement in physics, mathematics, and 
English, as shown by school records. It was immediately ap- 
parent, however, that the scholastic standards of each country 
are different, and, furthermore, that an evaluation of the 
courses of study even within each country would be extremely 
difficult. 

It was soon decided that in order to secure objectivity in 
the selection process, it would be necessary to give the candi- 
dates an examination which would measure such factors as 
knowledge of elementary physics, knowledge of English, and 
aptitude in physical science and language. The United States 
Civil Service Commission was asked to design such a battery 
of tests, to be translated into Spanish, Portuguese, and French. 

The examination was scheduled December 15 and 16, 1942, 
in the capital cities of the various Latin American nations. It 
was open to individuals between 20 and 30 years of age “who 
have completed the usual academic preparation for entrance 
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to the national university of their own or a neighboring 
country.” 

The written examination consisted of 4 objective tests com- 
posed of multiple choice items. Test 1 was a mathematics and 
physics test composed of eighty items, as follows: 35 mathe- 
matical problems in physics, 25 physics information items, and 
20 mathematics items. The 20 mathematics items consisted 
of 9 geometry, 5 algebra, 2 trigonometry, 2 analytic geometry, 
and 2 calculus items. Test 2 was an English test composed of 
100 items, as follows: thirty-five vocabulary items, fifteen 
grammar items, and fifty reading-comprehension items. Test 
3, a language aptitude test, was composed of 150 items, as fol- 
lows: forty items requiring the competitor to form words from 
jumbled letters, eighty items requiring the deciphering of coded 
words, and thirty items requiring the translation of an artificial 
language. Test 4, a physical-sciences aptitude test, consisted 
of 100 items, as follows: 25 spatial-ability items, 25 items re- 
quiring the competitors to predict the motion of various illus- 
trated mechanical devices, 25 items requiring the insertion of 
a missing number in a number series, and 25 items requiring the 
competitors to discover the differences in a set of similar geo- 
metrical diagrams. 

The examination was printed in Portuguese for administra- 
tion in Brazil; in French, for administration in Haiti; and in 
Spanish, for administration in the remaining Latin American 
nations. The examination scores of 708 competitors were avail- 
able for statistical analysis. The score on a single test was 
obtained by dividing the number of correct answers by the 
number of items in the test and multiplying by 100; the total 
score was obtained by adding together the number of correct 
answers on the four tests, dividing by the total number’ of 
items, and multiplying by 100. 


Findings 
Table 1 shows the number of cases, the means, and the 
standard deviations of total scores for the three translations 
of the examination. It is to be noted that a comparison of the 
mean scores of the Haitian competitors, the Brazilian competi- 
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TABLE 1 


Means and Standard Deviations of Total Scores on the Three Translations of 
the Examination 











Spanish Portuguese French 
Number of cases ............. 553 126 29 
re rer 49.5 519 53.9 
Standard deviation ........... 14.2 12.9 11.6 





tors, and the competitors from the Spanish-speaking nations 
provides no basis for concluding that the three translations of 
the examination differ sharply in difficulty from each other. 

Table 2 summarizes the obtained data relevant to the effec- 
tiveness of the 4 tests as selective devices. The sample of 185 
cases upon which the calculations were based was obtained by 
selecting every third paper from the papers of the competitors 
who took the Spanish translation of the examination. 

The figures of greatest interest in Table 2 are the estimated 
reliabilities of the four tests. The high estimated reliability of 
the English Test can be quite plausibly explained on the reason- 
able assumption that the range in the competitors’ knowledge 
of English was very great, as indicated by the fact that scores 
on the test ranged from 0 to 96. 

The extremely high estimated reliability of the Language 


TABLE 2 


Means, Standard Deviations, Estimated Reliabilities, and Intercorrelations of 
Scores on the Spanish Translation of the Tests, as Calculated 
from a Random Sample of 185 Cases 














Test I Test IV 
(Mathe- Test II Py est Ill (Physical- 
matics & (English) A rei 5 Science 
Physics) — Aptitude) 
Number of items in test .... 80 100 150 100 
Means of scores ........... 30 50 64 38 
Standard deviations of scores 12 19 24 12 
Estimated reliability* ...... 84 94 98 84 
Intercorrelations: 
BOE se nik we cp ea ckw ss 36 53 48 
EES aac ake ches 40 27 
WME URES Sc waceaodesnss 50 





* Computed by the Kuder-Richardson formula, Case IV. See G. F. Kuder and 
M. W. Richardson, “The Theory of the Estimation of Test Reliability,” Psycho- 
metrika, II (1937), 151-160. 
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Aptitude Test cannot be attributed primarily to the length of 
the test, since reduction of the number of items from 150 to 100 
would be expected to reduce the reliability of the test only by 
about 0.01; nor is it plausible to assume that the range of the 
language aptitude of the competitors was unusually great, in 
spite of the fact that scores on the test ranged from 2 to 95, 
since presumably the range in language aptitude among the 
competitors is roughly the same as would be found among a 
group of high-school graduates in the United States. One 
plausible explanation that suggests itself is that many of the 
competitors may have completely failed to understand the 
directions of one or more of the 4 different types of items con- 
tained in the test. If this actually occurred to a large extent, 
it would be expected that the test would have high reliability 
as a result of the fact that the test would function as a highly 
reliable measure of the competitors’ ability to understand the 
particular directions contained in the test. Such a test, how- 
ever, would be undesirable for the present purpose since not 
only would the test be a less effective measure of language apti- 
tude than it should be, but also it would not even be a good 
measure of ability to understand directions other than that 
particular set of directions contained in the test. 

The estimated reliabilities of the Mathematics and Physics 
Test and of the Physical-Science Aptitude Test are not so high 
as would be desirable. In the case of both these tests the low 
estimated reliability is presumably attributable to the fact that 
both tests appear to have been very difficult for the competi- 
tors. The ranges of scores on the two tests are from 0 to 70 
and from 6 to 74, respectively. For the present purposes, the 
low reliabilities of these tests are not so serious as might at first 
appear, since recent developments in test theory indicate that 
in the case of a very difficult test the scores of the higher-scoring 
competitors are probably more reliable than would be indicated 
by the reliability coefficient calculated from the scores of the 
entire group of competitors. 

The intercorrelations of the tests are not so high as to indi- 
cate a serious degree of duplication among the tests. As might 
have been anticipated, the correlations of the English Test with 
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the other three tests are the lowest of the obtained correlations, 
averaging roughly 0.35. The intercorrelations of the other 
three tests are all close to 0.50, indicating an appreciable, but 
not too serious, degree of overlapping. 


* * * * * 


Although Latin Americans have limited experience with 
objective tests, since most of their school examinations are of 
the essay type, the Latin American officials and the competi- 
tors were in general highly pleased that the award of the 
scholarships was made on the basis of merit determined by 
objective tests, rather than by personal selection. On the whole 
the project appears to have been highly satisfactory from the 
point of view of all concerned. 

















THE 1943-1944 WORK-SESSION OF THE COUNCIL OF 
GUIDANCE AND PERSONNEL ASSOCIATIONS 


THE sEconD Work-Session of the Council of Guidance and 
Personnel Associations was held at the Hotel Biltmore, New 
York, on Thursday, November eighteenth. The meetings 
were scheduled for November instead of January with the 
thought that the representatives of the constituent organiza- 
tions might profit from an earlier discussion of current problems. 

The morning session was largely devoted to the general 
subject of Rehabilitation. 

“Summary of Findings of 1942 Meeting with Emphasis on 

Changes during 1943” 

Lieutenant C. Gilbert Wrenn, Bureau of Naval Per- 
sonnel 

“Rehabilitation of Service Men and Women” 

Mr. William Gilchrist, Chief of Rehabilitations, Vet- 
erans Bureau 

Dr. Harry A. Jager, Chief, Occupational Information 
and Guidance Service, United States Office of 
Education 

“Rehabilitation of Working Students” 

Miss Beatrice McConnell, Director, Industrial Divi- 
sion, United States Department of Labor, Chil- 
dren’s Bureau 

Gilbert Wrenn gave a brief but very complete summary of the 
work-session of last January. He pointed out that we are now 
living out the plans discussed at the last meeting; and we are 
now anticipating the post-war problems. Mr. Gilchrist re- 
viewed government procedure as it is at present in operation. 
Dr. Jager spoke for the educational program that is just now 
getting under way. Miss McConnell reported briefly on the 
dislocation of the school population and the inevitable conse- 
quences which will some day have to be dealt with. 
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The afternoon session emphasized the need for the “Preser- 
vation of Social Values in a Time of War.” The speakers were 
Mr. Robert P. Lane, Executive Director, Welfare Council of 
New York, and Dr. Harry D. Gideonse, President, Brooklyn 
College. Mr. Lane’s speech was a philosophic approach to the 
social values in our civilization. President Gideonse discoursed 
on the social values which our educational system has tended to 
emphasize. 

At the dinner meeting the speaker was Dr. Luther Gulick, 
Chief of the Planning Division, Office of Foreign Relief and 
Rehabilitation. Dr. Gulick had just come from the meetings 
in Atlantic City and spoke on “Rehabilitation Abroad.” 

On Friday the Executive Council of the American College 
Personnel Association held its annual meeting. The members 
present were E. G. Williamson, President; Gilbert Wrenn, Vice- 
President; D. D. Feder, Secretary; Thelma Mills and Helen 
Voorhees. Other members in attendance were A. J. Brum- 
baugh, John G. Darley, Winifred Hausam, Forrest Kirkpatrick, 
James McClintock and Robert Moore. 

The necessary business was transacted and then the group 
discussed at length some of the problems of post-war counsel- 
ling. The results of our deliberation will be reported to you in 
due time. 


HELEN VoorHEES 
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Rabin, A. I. “A Short Form of the Bellevue-Wechsler Test.” Journal of Applied 

Psychology, XXVII (1943), 320-324. 

Correlations of the combined scores on three sub-tests (Comprehension, Arith- 
metic, and Similarities) of the Bellevwe-Wechsler Test with the total test and the 
Army Alpha yielded correlations as high as those usually obtained between two 
intelligence tests. The subjects in the. study were 92 nurses and 200 hospital 
patients. In using the short form the I.Q. is determined by administering the three 


-x 10, in 


which X is the total score and C.A.S. the weighted scores in the sub-tests, and 
referring to the I.Q. tables for the various age groups. Lorraine Bouthilet. 





tests in the usual manner, computing the score by the formula, X = 





Lawshe, C. H., Jr. and Thornton, G. R. “A Test Battery for Identifying Potentially 
Successful Naval Electrical Trainees.” Journal of Applied Psychology, XXVII 
(1943), 399-406. 

The purpose of this study was to develop a battery of tests to be used in identi- 
fying men most likely to be successful in a Naval Training School for Electricians. 
From correlations of scores on a preliminary group of tests with grade-point aver- 
ages in the five courses, a final battery of three tests, ability to read simple measure- 
ments and solve arithmetic problems, electrical information, and mental alertness, 
was selected. Using a regression equation to predict achievement of a new group 
of men, it was possible to establish a critical score, on the basis of the grade-point 
averages predicted from the tests, which would eliminate practically all failures. 
Lorraine Bouthilet 


* Edited by Forrest A. Kingsbury. 
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Gottsdanker, R. M. “Measures of Potentiality for Machine Calculation.” Journal 

of Applied Psychology, XXV (1943), 233-249. 

A battery of nine paper-and-pencil tests, chosen on the basis of a job analysis, 
was assembled in order to obtain a measure of the abilities needed for proficiency 
in the operation of machine calculators. Scores of the battery were validated against 
the performances of 44 women learning to be machine operators. As a result of an 
analysis of the validity correlations, a final battery of three tests, the Number-Dot 
Location, Arithmetic Computation, and Tapping tests, selected by means of the 
Wherry-Doolittle test selection method, gave a multiple correlation of .57 with the 
criterion. The test-retest reliability coefhcient for test scores from another group of 
subjects was estimated to be .89 for the final battery. The author believes that the 
multiple correlation coefficient of validity may be spuriously low due to the homoge- 
neity of the criterion group and the errors of measurement in their achievement 
scores. Lorraine Bouthilet. 





Frandsen, A. N. and Hadley, J. M. “Prediction of Achievement in a Radio Training 

School.” Journal of Applied Psychology, XXV (1943), 303-310. 

In an attempt to predict success in a radio training school for Naval and Marine 
recruits, the correlations between tests of intelligence, interest in radio, mathematical 
ability, "technical information of various kinds, and the achievement scores on the 
curriculum were estimated. It was found that the most efficient measure for pre- 
dicting achievement by use of the multiple regression equation was a combination 
of either one of the mathematics tests and the Technical Information in Electricity 
Test, with scores on the intelligence test and interest questionnaire adding little to 
the accuracy of prediction. Lorraine Bouthilet. 





Maddy, Nancy Ruth. “Comparison of Children’s Personality Traits, Attitudes, and 
Intelligence with Parental Occupation.” Genetic Psychoogy Monographs, 
XXVII (1943), 3-65. 

The most significant results of this study of the emotional make-up and intelli- 
gence of children in two widely divergent socio-occupational groups indicate that 
reliable differences in intelligence and personality traits do exist between children in 
these two groups, with greater difference being found for girls than for boys. Certain 
traits, extroversion, dominance, and emotional stability, were more pronounced in 
children of the professional group whereas children of the semi-skilled seemed to have 
more worries. Variations from the average scores for the particular group to which 
the children belonged were noted in the cases of those children who lived in neighbor- 
hoods not representative of their occupational groups. C. A. McNally 





Ames, Viola. “Factors Related to High School Achievement.” The Journal of Edu- 

cational Psychology, XXXIV (1943), 229-237. 

The author is concerned with the isolation of certain personality traits which 
may be used in addition to intelligence scores in the prediction of scholastic achieve- 
ment in high school. The results of the study indicate a significant relation between 
the ability to conform to school situations and scholastic achievement, whereas no 
relation was found between achievement and the ability to succeed socially. C. A. 
McNally 


Miller, Leo R. “Some Results of Retesting Elementary-School Pupils with the 
Stanford Revision of the Binet-Simon Scale.” Journal of Educational Psychol- 
ogy, XXXIV (1943), 237-242. 

Forty-five boys and forty-five girls of one grammar school were tested on the 
1916 Stanford-Binet and retested on the 1937 Revised Stanford-Binet (Form L). 
The mean chronological age at the time of the first test was 5.86 years and at the 
time of the second test 12.3 years, the mean interval between the two tests being 
6.5 years. Variations in scores between the two tests ranged from 0-34 I.Q. points. 
The author found that boys are more likely to gain in I.Q. score over a long period 
of time, whereas girls are more likely to lose. He concludes from his results that 
prediction based on one test, given at the beginning of the child’s school career, 
without retesting, can be more harmful than failure to give any intelligence test 
at all. Miriam Rotman. 





. 
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Gilkinson, Howard. “The Seashore Measures of Musical Talent and Speech Skill.” 

Journal of Applied Psychology, XXVII (1943), 443-448. 

The proposition that vocal performance is dependent upon some types of audi- 
tory abilities that are measured by the Seashore Tests is investigated. Conclusions, 
based on the results of three studies, are: (a) No positive relationship can be deter- 
mined between specific speech qualities and the Seashore Tests. (b) Slight positive 
relationship was found between degree of speech excellence and the score on the 
Seashore Tests. (c) “Practical diagnostic value in general speech courses is very 
questionable.” Francis Medland. 





Teegarden, Lorene. “Occupational Differences in Manipulative Performance of 
Applicants at a Public Employment Office.” Journal of Applied Psychology, 
XXVII (1943), 416-438. 

The author has previously described a battery of performance tests which were 
administered to applicants at the Cincinnati Employment Center and from which 
norms for each sex were developed. These tests were grouped together to get some 
measure of manipulative ability. In this study each applicant’s performance on the 
battery is studied in relation to that of other applicants who had had experience in 
the same occupation or occupations as those claimed by the applicant. Each occu- 
pational group, taken as a whole, includes records of long and short experience, of 
efficient and inefficient workers. All ages were included, with the majority between 
sixteen and twenty-five years of age. Only white subjects were used. The occupa- 
tions of the men were (1) helpers in skilled trades, (2) truck drivers and chauffeurs, 
(3) truck helpers and loaders, (4) factory labor, hand operators, (5) factory machine 
operators, (6) sales clerks, (7) waiters, kitchen helpers, bus boys, and dish washers, 
(8) manual laborers; those of the women were (1) factory workers at hand opera- 
tions, (2) assemblers, inspectors, testers, (3) packers and wrappers, (4) sales clerks, 
(5) waitresses, (6) domestic workers. The results show that differences do appear 
between certain occupational groups. These differences are greater in ability to 
solve problems, in accuracy of movement, and in ability to react to multiplicity of 
details than in rapidity of hand movement or coordination of two-hand movement. 
Miriam Rotman. 





Goodman, Charles H. “A Factorial Analysis of Thurstone’s Sixteen Primary Mental 

Abilities Tests.” Psychometrika, VIII (1943), 141-151. 

This article deals with a factorial analysis of Thurstone’s Primary Mental Abili- 
ties Tests. The analysis was made in order to determine whether the tests desig- 
nated to measure a particular ability would be found upon completion of the analysis 
to be clustered together with significant loadings and be isolated from the tests of the 
other abilities. The results show that most of the tests specifically designed to 
measure six of the abilities were isolated with loadings varying in size. The tests 
for the remaining ability were not isolated. It is also shown that the tests are 
complex in nature, measuring more than any one single ability. (Courtesy of 
Psychometrika.) 





Festinger, Leon. “An Exact Test of Significance for Means of Samples Drawn from 
Populations with an Exponential Frequency Distribution.” Psychometrika, 
VIII (1943), 153-160. 

The mathematical derivation of a test for determining the fiducial limits of, 
and significance of difference between, means when the samples are drawn from 
exponential populations is presented. The test for differences between means takes 
the particularly simple form of the F test (the ratio of the larger to the smaller 
mean) with each mean possessed of 2n degrees of freedom, being the number of 
cases in the sample. Random sampling, a range of scores upwards from a lower 
limit of zero, and independence of means from each other are necessary assumptions 
for the use of the test. Examples of situations in which the test should be used are 
given, together with a description of the necessary computational procedures. Com- 
parisons of the results of the application of this test with the erroneous application 
of the critical ratio on actual data show that rather large discrepancies exist between 
the two tests. Results obtained by applying tests which assume normality to expo- 
nential distributions are subject to much error. (Courtesy Psychometrika.) 
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Mosier, Charles I. “On the Reliability of a Weighted Composite.” Psychometrika, 

VIII (1943), 161-168. 

A general formula for the reliability of a weighted composite has been derived 
by which that reliability can be estimated from a knowledge of the weights whatever 
their source, reliabilities, dispersions, and intercorrelations of the components. The 
Spearman-Brown formula has been shown to be a special case of the general state- 
ment. The effect of the internal consistency or intercorrelation of the components 
has been investigated and the conditions defining the set of weights yielding maxi- 
mum reliability shown to be that the weight of a component is proportional to the 
sum of its intercorrelations with the remaining components and inversely proportional 
to its error variance. (Courtesy Psychometrika.) 





Guttman, Louis and Cohen, Jozef. “Multiple Rectilinear Prediction and the Reso- 

lution into Components: II.” Psychometrika, VIII (1943), 169-183. 

Given a battery of m tests that has already been resolved into r orthogonal 
common factors and m unique factors, procedures are outlined for computing the 
following types of linear multiple regressions directly from the factor loadings: (i) 
the regression of any one test on the »—1 remaining tests; (ii) all the different 
regressions of order n—1 for the n tests, computed simultaneously; (iii) the regres- 
sion of any common factor on the n tests; (iv) the regressions of all the common 
factors on the n tests computed simultaneously; (v) the regression of any unique 
factor on the n tests; (vi) the regressions of all the unique factors on the 1 tests, 
computed simultaneously. Multiple and partial correlations are then determined 
by ordinary formulas from the regression coefficients. A worksheet with explicit 
instructions is provided, with a completely worked out example. Computing these 
regressions directly from the factor loadings is a labor-saving device, the efficiency 
of which increases as the number of tests increases. The amount of labor depends 
essentially on the number of common factors. This is in contrast to computations 
based on the original test intercorrelations, where the amount of labor increases more 
than proportionately as the number of tests increases. The procedures evaluate 
formulas developed in a previous paper. They are based essentially on a shortened 
way of computing the inverse of the test intercorrelation matrix by use of the factor 
loadings. (Courtesy Psychometrika.) 





Greenwood, J. A. “A Preferential Matching Problem.” Psychometrika, VIII 

(1943), 185-191. 

A matching method proposed by Dr. C. E. Stuart is presented in some detail 
and the essentials for a test of significance are derived. This method differs from 
the older matching methods in that partial credit is allowed for a near miss. A 
slight variation of the method permits the matching of one item with M sets of n 
traits. (Courtesy Psychometrika.) 




















NEW TESTS* 


Cooperative Pre-Flight Aeronautics Tests, Provisional Form A, 1943. 

Test 1: Aerodynamics and Aircraft Structures, by Col. R. H. Drake, Ens. K. V. 
Jackman, Alexander Joseph, Louis Teichman, and Carl A. Pearson. 
Time, 40 minutes. 

Test 2: Aircraft Engines, by Col. R. H. Drake, Ens. K. V. Jackman, James L. G. 
Fitzpatrick, and Carl A. Pearson. Time, 40 minutes. 

Test 3: Meteorology, by Col. R. H. Drake, Ens. K. V. Jackman, and Rosalie K. 
Kirschen. Time, 40 minutes. 

Test 4: Navigation, by Col. R. H. Drake, Ens. K. V. Jackman, and Meta Roth- 
holz. Time, 40 minutes. 

Test 5: Part I, Radio and Communications; Part II, Civil Air Regulation, by Col. 
R. H. Drake, Ens. K. V. Jackman, and Alexander Joseph. Time, 40 
minutes. 

These tests are for the 11th and 12th grades and junior college level. Norms for 

total and part scores for the 12th grade are furnished. Each booklet, 10 to 99 

copies, 6¢; 100 or more copies, 54¢. Specimen set, including one copy of each 

booklet, 50¢. The tests may be hand- or machine- scored: machine-scored answer 
sheets, ‘li¢ each. Machine-scoring stencil, 30¢. Published by the Cooperative 

Test Service, 15 Amsterdam Avenue, New York, N. Y 





Cooperative College Biology Test, Provisional Form T, by Carl A. Pearson and 
others, 1943. Time, 90 minutes. This test is for first-year college biology a 
for which tentative percentile norms are provided. 10 to 99 copies, 7¢ each 
or more copies, 63¢. Specimen set, 25¢. The test may be hand- or ra ang 
scored: machine-scored answer sheets, 2¢ each; machine-scoring stencil, 30¢. 
— by the Cooperative Test Service, 15 Amsterdam Avenue, New York, 

Se 





Cooperative College Mathematics Test, Provisional Form T, by Emma Spaney and 
T. Freeman Cope, Marguerite D. Darkow, Richard E. Henry, C. V. Newsom, Fred 
Robertson, and E. R. Smith, 1943. Time, 40 minutes. This test is for first-year 
college mathematics classes. 10 to 99 copies, 6¢; 100 or more copies, 54¢. Speci- 
men set, 25¢. The test may be hand- or machine-scored: machine-scored answer 
sheets, 14¢ each; machine-scoring stencil, 15¢. Published by the Cooperative Test 
Service, 15 Amsterdam Avenue, New York, N. Y 





Watson-Glaser Tests of Critical Thinking, Form A: Battery I, Discrimination in 
Reasoning; Battery II, Logical Reasoning, by Goodwin Watson and Edward May- 
nard Glaser, 1942. No exact time limit, but the time required is about one hour, 
which may be divided into two sittings. This test is for high school, college and 
adult levels. Package of 25 tests, either battery, $2.00. Specimen set, both bat- 
teries, 45¢. This test is hand- or machine-scored: machine-scored answer sheets, 
package of 25 for either ne ae Published by World Book Company, 
Yonkers-on-Hudson, New York, N 





lowa Silent Reading Tests, Elementary Test, Forms Am and Bm revised, Forms Cm 
Dm new edition, by H. A. Greene and V. H. Kelley, 1943. Time, 49 min- 


* Prepared by Mrs. John Segrave, Jr., The University of Chicago. 
81 


82 EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


utes. This test is for grades 4 to 9, for which norms are provided. Per package 
of 25, $1.45. Specimen set, 35¢. "The test may be hand- or machine-scored: 
machine-scored answer sheets, per package of 25, $1.15; scoring keys for any form, 
— Published by World Book Company, Yonkers-on-Hudson, New York, 


Towa Silent Reading Tests, Advanced Test, Forms Am and Bm revised, Forms Cm 
and Dm, new edition, by H. A. Greene, A. N. Jorgensen, and V. H. Kelley, 1943. 
Time, 45 minutes. This test is for high-school and college students, for which 
norms are provided. Per package of 25, $1.80. Specimen set, 40¢. The test may 
be hand-or machine-scored: machine-scored answer sheets, per package of 25, $1.15, 
scoring keys for any form, each 80¢. Published by World Book Company, 
Yonkers-on-Hudson, New York, N. Y. 








Victory Corps Aeronautics Aptitude Test. U.S. Office of Education, Federal Secur- 
ity Agency. Grades 10, 11,12. Time, 90 minutes. Test booklets, $7.50 per 100; 
answer sheets, $2.00 per thousand. For sale by Superintendent of Documents, 
Washington, D. C. Sample copies may be obtained from the U. S. Office of Edu- 
cation, Federal Security Agency, Washington, D. C 





Personnel Test, by E. F. Wonderlic. Forms A and B. For adults. Time, 12 min- 
utes. $5.00 per 100; specimen set (10 copies), 75 cents. Published by E. F. 
Wonderlic, 919 North Michigan Avenue, Chicago, Illinois. 





Inventory of Affective Tolerance, by Robert I. Watson and V. E. Fisher. $4.00 per 
00, $2.25 per 50; specimen set, without scoring keys, 15 cents; scoring keys, 25 
cents per set. Published by Sheridan Supply Company, P.O. Box 837, Beverly 
Hills, California. 


























NEWS NOTES* 





In July a new Katherine Gibbs school was opened in Chicago. Dorothy Coats, 
who had formerly been Placement Director in the Boston school, was made Director 
of the Chicago school. 





Nora A. Congdon, Colorado State College of Education, has been in Washington 
on a temporary assignment with the Civil Aeronautics Administration as Educational 
Consultant, Aviation Education Service. The C.A.A. in co-operation with the 
American Council on Education is making a study evaluating certain phases of 
aeronautics courses as taught in high schools during the year 1942-43. 





Lt. Colonel Lysle W. Croft is Commanding Officer of SCU No. 3410 Star, Basic 
Training Center, ASTP, Fort Benning, Georgia. This unit is the classification, test- 
ing, and statistical center for processing Army Ground Forces Personnel. Colonel 
Croft says the work reminds him very much of the work of the admissions office and 
the personnel office of a large university. They have complete interviewing, testing, 
reviewing, screening, and statistical teams. These teams are formed for specialized 
work so that they can completely classify and screen large numbers of candidates 
per week. They also have a Personnel Consultant Section which handles problem 
and maladjustment cases. It is Colonel Croft’s belief that the personnel work being 
done in the Army will affect college personnel work in new trends and developments. 





On October first, Neal E. Drought resigned from his position as assistant dean 
and assistant professor of education at Hamilton College, to join the staff of the 
Personnel Planning and Research Division of R.C.A.-Victor in Camden, New Jersey. 
His new responsibilities involve the development and coordination of personnel 
policies and procedures in the several R.C.A.-Victor plants. 





Wm. C. Johnson, Jr., Director of Placement, Virginia Polytechnic Institute, has 
accepted a position with the Goodyear Aircraft Corporation i in Akron, Ohio. 





Harry W. Seamans, General Secretary of the Penn State Christian Association, 
Pennsylvania State College, has recently accepted a position as Senior Community 
Participation Adviser, National Housing Agency, Office of the Administrator, Wash- 
ington, D 





Since early in 1942, Donald E. Super, Associate Professor of Educational Psy- 
chology and Director of ‘the Personnel Bureau at Clark University, has been on leave 
of absence for duty with the armed services. At present he is a Captain in the 
Army Air Corps stationed at Nashville, Tennessee, with the Nashville Army Air 
Center (AAFCC) Psychological Research Unit No. i. As Test Development Officer 
for this unit his duties include job analysis, and development of tests for pilots, navi- 
gators, and bombardiers, and have involved such things as field studies, flying on 
training missions, and going partially through pilot training as a participant observer. 
“ss has a number of enlisted psychologists as assistants in the Test Development 

ection. 





* News items concerning members of the American College Personnel Association 
should be sent to Grace E. Manson, Northwestern University, Evanston, Illinois. 
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Lieut. (j.g.) R. L. Swann, U.S.N.R., was granted a leave of absence as Director 
of Personnel at Green Mountain Junior College, to enter the Navy as a reserve 
officer. After serving seven months as Psychologist at the U. S$. Naval Aviation 
Selection Board, Dallas, Texas, he was ordered to the U. S. Naval Flight Prepara- 
tory School, University of South Carolina, Columbia, South Carolina, where he is 
Psychological Officer. Much of his time is spent in counseling the V—5 cadets on 
study habits and personnel problems. 


J. E. Walters, Vice President in charge of Personnel and Labor Relations, Revere 
Copper and Brass, Inc., has resigned to join McKinsey and Co., management consul- 
tants, 60 E. Forty-second St., New York City. 


Public announcement has recently been made by the War Manpower Commis- 
sion of revised policies and procedures in connection with the placement and trans- 
ference of personnel, including professional and scientific personnel registered with 
the National Roster. These new regulations are embodied in Regulations 4 and 7 
of the War Manpower Commission and Selective Service Local Board Memoranda 
115, 115-B, and 149. 





